2024-09-10T09:12:20.389 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T09:12:20.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T09:12:20.504 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965 branch: wip-rishabh-testing-20240909.165402-squid description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} email: null first_in_suite: false job_id: '7898965' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYjRbfBKONCSTDHOHSWvnGYLVbAaq2X5vLVSseP+pl/PwW58+CYMP8HNeoz7w91pSoPGCh9SMGYmXvR2vOfF/o= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpKyjVGDd1s1vooGSgfdVv6u5l+xqYvLP6D8vi01TLfywI12+6FbcU+AYo0AI+dsu1I9E7iGx91/Bjx76aVrLA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T09:12:20.504 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T09:12:20.505 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T09:12:20.505 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T09:12:20.506 INFO:teuthology.task.internal:Checking packages... 2024-09-10T09:12:20.525 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T09:12:20.525 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:12:20.525 INFO:teuthology.packaging:ref: None 2024-09-10T09:12:20.525 INFO:teuthology.packaging:tag: None 2024-09-10T09:12:20.525 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:12:20.525 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:12:20.526 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:12:20.668 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T09:12:20.670 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T09:12:20.676 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T09:12:20.676 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T09:12:20.695 INFO:teuthology.task.internal:Saving configuration 2024-09-10T09:12:20.711 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T09:12:20.718 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T09:12:20.743 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:07:16.361151', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYjRbfBKONCSTDHOHSWvnGYLVbAaq2X5vLVSseP+pl/PwW58+CYMP8HNeoz7w91pSoPGCh9SMGYmXvR2vOfF/o='} 2024-09-10T09:12:20.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:07:16.363145', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpKyjVGDd1s1vooGSgfdVv6u5l+xqYvLP6D8vi01TLfywI12+6FbcU+AYo0AI+dsu1I9E7iGx91/Bjx76aVrLA='} 2024-09-10T09:12:20.769 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T09:12:20.775 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T09:12:20.775 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T09:12:20.775 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T09:12:20.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6393fd3be0>, signals=[15]) 2024-09-10T09:12:20.836 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T09:12:20.843 INFO:teuthology.task.internal:Opening connections... 2024-09-10T09:12:20.843 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:12:20.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:12:20.925 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:12:20.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:12:20.998 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T09:12:21.004 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-10T09:12:21.022 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-10T09:12:21.022 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-10T09:12:21.079 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-10T09:12:21.079 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:12:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:12:21.081 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-10T09:12:21.109 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-10T09:12:21.130 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-10T09:12:21.131 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:12:21.188 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:12:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:12:21.189 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:12:21.189 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-10T09:12:21.208 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T09:12:21.217 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T09:12:21.221 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T09:12:21.221 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:12:21.224 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:12:21.245 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T09:12:21.250 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T09:12:21.250 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:12:21.281 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:12:21.311 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T09:12:21.355 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T09:12:21.368 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T09:12:21.368 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-10T09:12:21.368 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-10T09:12:21.369 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:12:21.369 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:12:21.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:12:21.386 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-10T09:12:21.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:12:21.387 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-10T09:12:21.443 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:12:21.443 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-503.el9.x86_64 2024-09-10T09:12:21.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-09-10T09:12:21.444 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:12:21.445 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-10T09:12:21.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-10T09:12:23.873 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T09:12:24.871 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-10T09:12:25.707 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-10T09:12:30.579 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-10T09:12:31.358 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-10T09:12:33.133 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-10T09:12:33.921 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-10T09:12:36.404 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-10T09:12:38.096 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-10T09:12:39.008 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-10T09:12:39.368 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T09:12:41.383 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T09:12:41.383 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T09:12:41.488 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-10T09:12:41.494 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-10T09:12:41.495 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:12:41.496 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-10T09:12:41.496 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-10T09:12:41.496 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-10T09:12:41.787 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 85 kB/s | 23 kB 00:00 2024-09-10T09:12:44.622 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-09-10T09:12:46.687 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T09:12:46.687 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T09:12:46.791 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-10T09:12:46.802 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T09:12:46.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 79 M 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 126 M 2024-09-10T09:12:46.804 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-10T09:12:46.899 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 306 kB/s | 23 kB 00:00 2024-09-10T09:12:47.382 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-10T09:12:47.733 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-10T09:12:48.016 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-10T09:12:48.017 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:12:48.017 INFO:teuthology.orchestra.run.smithi012.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-10T09:12:48.731 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-10T09:12:49.142 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-10T09:12:49.142 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-10T09:12:50.092 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-10T09:12:50.093 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-10T09:12:52.650 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-10T09:12:53.309 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:12:53.400 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:12:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:12:56.338 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:12:57.343 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-10T09:13:01.462 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:13:01.505 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:04.201 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 1.5 MB/s | 35 MB 00:22 2024-09-10T09:13:06.644 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:13.708 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 916 kB/s | 29 MB 00:31 2024-09-10T09:13:13.709 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:13:13.709 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.4 MB/s | 79 MB 00:32 2024-09-10T09:13:14.391 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-10T09:13:14.756 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-10T09:13:14.756 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-10T09:13:15.703 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-10T09:13:15.704 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-10T09:13:18.148 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-10T09:13:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:13:18.951 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:13:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:13:21.871 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:13:26.693 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:13:26.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:31.690 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:13:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:13:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:13:46.755 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:13:46.756 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-10T09:13:47.108 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:13:47.210 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:13:47.210 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:13:47.211 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T09:13:47.211 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T09:13:47.211 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T09:13:47.211 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T09:13:47.211 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T09:13:47.211 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:13:47.269 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:13:47.270 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:13:47.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 82.el9 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8274670 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:13:47.308 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:13:47.309 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:13:47.310 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:13:47.310 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-505.el9.x86_64 2024-09-10T09:13:47.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:13:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-10T09:13:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:13:49.260 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-10T09:13:49.263 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-10T09:13:49.278 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.fdLngGCihm 2024-09-10T09:13:49.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fdLngGCihm 2024-09-10T09:13:49.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.fdLngGCihm 2024-09-10T09:13:49.490 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.fdLngGCihm is 6KB 2024-09-10T09:13:49.537 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.fdLngGCihm 2024-09-10T09:13:49.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:13:49.621 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:13:49.621 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:13:49.622 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:13:49.622 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T09:13:49.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T09:13:49.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-10T09:14:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:14:09.834 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:14:10.168 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:14:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:14:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:14:10.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:14:10.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:14:10.968 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:14:10.968 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-10T09:14:10.968 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T09:14:10.968 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T09:14:10.968 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T09:14:10.969 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T09:14:10.969 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:14:10.969 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-10T09:14:11.341 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:14:11.437 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:14:11.437 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:14:11.437 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T09:14:11.438 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T09:14:11.438 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T09:14:11.438 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-10T09:14:11.438 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T09:14:11.438 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:14:11.497 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:14:11.497 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:14:11.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-10T09:14:11.529 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-10T09:14:11.529 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:14:11.530 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:14:11.531 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:14:11.532 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:14:11.532 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-505.el9.x86_64 2024-09-10T09:14:11.532 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:14:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-10T09:14:13.601 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:14:13.633 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-10T09:14:13.635 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-10T09:14:13.652 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.uLIpoC8OgP 2024-09-10T09:14:13.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uLIpoC8OgP 2024-09-10T09:14:13.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.uLIpoC8OgP 2024-09-10T09:14:13.868 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.uLIpoC8OgP is 6KB 2024-09-10T09:14:13.893 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.uLIpoC8OgP 2024-09-10T09:14:13.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:14:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:14:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:14:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:14:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T09:14:13.984 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T09:14:14.146 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-10T09:14:19.787 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T09:14:19.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T09:14:19.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:14:44.173 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-10T09:14:44.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:14:44.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:15:02.589 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-10T09:15:11.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:15:11.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:15:14.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-10T09:15:19.793 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T09:15:26.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:15:26.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:15:28.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T09:15:28.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:15:29.167 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-10T09:15:29.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T09:15:29.504 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T09:15:29.505 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-10T09:15:29.519 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-505.el9.x86_64 2024-09-10T09:15:29.520 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T09:15:29.520 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:15:29.520 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:15:30.521 DEBUG:teuthology.parallel:result is None 2024-09-10T09:15:45.085 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-10T09:16:00.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:16:00.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:16:00.401 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-10T09:16:00.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:16:00.963 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-10T09:16:00.963 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-10T09:16:01.007 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-505.el9.x86_64 2024-09-10T09:16:01.007 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T09:16:01.007 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:16:01.007 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:16:02.008 DEBUG:teuthology.parallel:result is None 2024-09-10T09:16:02.009 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T09:16:02.016 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T09:16:02.017 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:16:02.020 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:16:02.036 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T09:16:02.046 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T09:16:02.054 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T09:16:02.054 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:16:02.079 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:16:02.113 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T09:16:02.118 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T09:16:02.119 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:16:02.150 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:16:02.209 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:16:02.254 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:16:02.257 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:16:02.272 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:16:02.274 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T09:16:02.281 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T09:16:02.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:16:02.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:16:02.311 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T09:16:02.320 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T09:16:02.320 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:16:02.354 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:16:02.370 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:16:02.449 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:16:02.505 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:16:02.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:16:02.635 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:16:02.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:16:02.701 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:16:02.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:16:02.789 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:16:02.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:16:02.910 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:16:02.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:16:02.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-10T09:16:02.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-10T09:16:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:16:03.059 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:16:03.571 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T09:16:03.579 INFO:teuthology.task.internal:Starting timer... 2024-09-10T09:16:03.579 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T09:16:03.592 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T09:16:03.601 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T09:16:03.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-10T09:16:03.672 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-10T09:16:03.674 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-10T09:16:03.731 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-10T09:16:03.733 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T09:16:03.733 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-10T09:16:03.757 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-10T09:16:03.757 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-10T09:16:03.782 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-10T09:16:03.782 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive'} 2024-09-10T09:16:03.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:16:03.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:16:03.827 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:16:03.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:16:03.853 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T09:16:03.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:16:03.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:16:03.931 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T09:16:03.940 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T09:16:03.943 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T09:16:04.086 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T09:16:04.098 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T09:16:04.099 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi100.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T09:19:49.380 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com')] 2024-09-10T09:19:49.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T09:19:49.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:19:49.462 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-10T09:19:49.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-10T09:19:49.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:19:49.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:19:49.615 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-10T09:19:49.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T09:19:49.694 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T09:19:49.705 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T09:19:49.705 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:19:49.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:19:49.709 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:19:49.709 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:19:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:19:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:19:49.764 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:19:49.779 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-10T09:19:49.779 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:19:49.790 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-10T09:19:49.804 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-10T09:19:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:19:49.815 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-10T09:19:49.820 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:19:49.829 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:19:49.843 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:19:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:19:49.885 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:19:49.885 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-10T09:19:49.885 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.885 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.885 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.886 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.901 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:19:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:19:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-10T09:19:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:19:49.905 INFO:teuthology.run_tasks:Running task install... 2024-09-10T09:19:49.914 DEBUG:teuthology.task.install:project ceph 2024-09-10T09:19:49.914 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T09:19:49.914 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T09:19:49.914 INFO:teuthology.task.install:Using flavor: default 2024-09-10T09:19:49.919 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T09:19:49.920 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T09:19:49.920 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:19:49.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:19:49.923 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:19:49.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:19:50.077 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T09:19:50.077 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T09:19:50.083 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T09:19:50.083 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T09:19:50.192 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:19:50.193 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:19:50.193 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:19:50.197 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:19:50.197 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:19:50.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:19:50.219 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T09:19:50.219 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:19:50.226 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T09:19:50.226 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:19:50.285 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:19:50.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:19:50.360 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:19:50.370 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:19:50.425 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-10T09:19:50.426 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-10T09:19:50.436 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-10T09:19:50.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-10T09:19:50.655 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-10T09:19:50.675 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-10T09:19:50.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T09:19:50.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T09:19:51.241 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-10T09:19:51.276 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-10T09:19:51.517 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-10T09:19:51.560 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T09:19:51.776 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-10T09:19:51.836 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-10T09:19:52.251 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-10T09:19:52.369 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-10T09:19:55.578 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-10T09:19:56.610 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-10T09:19:59.887 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-10T09:20:01.588 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-10T09:20:02.542 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-10T09:20:02.544 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-10T09:20:04.103 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-10T09:20:04.957 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-10T09:20:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-10T09:20:10.396 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-10T09:20:10.711 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:20:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:20:10.726 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T09:20:10.727 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T09:20:10.728 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T09:20:10.729 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T09:20:10.731 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T09:20:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T09:20:10.735 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T09:20:10.802 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T09:20:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T09:20:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T09:20:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T09:20:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T09:20:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:20:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T09:20:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:20:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:20:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:20:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:20:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:20:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-10T09:20:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-10T09:20:10.835 INFO:teuthology.orchestra.run.smithi012.stdout:Install 148 Packages 2024-09-10T09:20:10.835 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 8 Packages 2024-09-10T09:20:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:20:10.835 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 226 M 2024-09-10T09:20:10.835 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-10T09:20:11.482 INFO:teuthology.orchestra.run.smithi012.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-10T09:20:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 3.8 MB/s | 897 kB 00:00 2024-09-10T09:20:11.824 INFO:teuthology.orchestra.run.smithi012.stdout:(3/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T09:20:11.849 INFO:teuthology.orchestra.run.smithi012.stdout:(4/156): ceph-immutable-object-cache-19.1.1-305 1.1 MB/s | 145 kB 00:00 2024-09-10T09:20:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 19 MB/s | 2.4 MB 00:00 2024-09-10T09:20:12.142 INFO:teuthology.orchestra.run.smithi012.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-10T09:20:12.209 INFO:teuthology.orchestra.run.smithi012.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-10T09:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 17 MB/s | 21 MB 00:01 2024-09-10T09:20:12.642 INFO:teuthology.orchestra.run.smithi012.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 505 kB/s | 25 kB 00:00 2024-09-10T09:20:12.734 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:20:12.735 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:20:12.748 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T09:20:12.749 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T09:20:12.750 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T09:20:12.751 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T09:20:12.753 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T09:20:12.756 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T09:20:12.757 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T09:20:12.820 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-10T09:20:12.834 INFO:teuthology.orchestra.run.smithi012.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 17 MB/s | 11 MB 00:00 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T09:20:12.840 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T09:20:12.841 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T09:20:12.842 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T09:20:12.843 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-10T09:20:12.844 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T09:20:12.845 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T09:20:12.846 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T09:20:12.847 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T09:20:12.848 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T09:20:12.849 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:20:12.850 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:20:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:20:12.852 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:20:12.853 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-10T09:20:12.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:20:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-10T09:20:12.855 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-10T09:20:12.893 INFO:teuthology.orchestra.run.smithi012.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 3.8 MB/s | 228 kB 00:00 2024-09-10T09:20:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 360 kB/s | 27 kB 00:00 2024-09-10T09:20:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 423 kB/s | 32 kB 00:00 2024-09-10T09:20:13.153 INFO:teuthology.orchestra.run.smithi012.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-10T09:20:13.336 INFO:teuthology.orchestra.run.smithi012.stdout:(15/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 14 MB/s | 17 MB 00:01 2024-09-10T09:20:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 785 kB/s | 164 kB 00:00 2024-09-10T09:20:13.395 INFO:teuthology.orchestra.run.smithi012.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.1 MB/s | 127 kB 00:00 2024-09-10T09:20:13.428 INFO:teuthology.orchestra.run.smithi012.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 7.4 MB/s | 506 kB 00:00 2024-09-10T09:20:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 773 kB/s | 45 kB 00:00 2024-09-10T09:20:13.506 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-10T09:20:13.571 INFO:teuthology.orchestra.run.smithi012.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.6 MB/s | 136 kB 00:00 2024-09-10T09:20:13.663 INFO:teuthology.orchestra.run.smithi012.stdout:(21/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-10T09:20:13.688 INFO:teuthology.orchestra.run.smithi012.stdout:(22/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.3 MB/s | 161 kB 00:00 2024-09-10T09:20:13.721 INFO:teuthology.orchestra.run.smithi012.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 5.4 MB/s | 320 kB 00:00 2024-09-10T09:20:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.0 MB/s | 301 kB 00:00 2024-09-10T09:20:13.780 INFO:teuthology.orchestra.run.smithi012.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T09:20:13.814 INFO:teuthology.orchestra.run.smithi012.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-10T09:20:13.922 INFO:teuthology.orchestra.run.smithi012.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.5 MB/s | 170 kB 00:00 2024-09-10T09:20:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 318 kB/s | 32 kB 00:00 2024-09-10T09:20:14.090 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.5 MB/s | 897 kB 00:00 2024-09-10T09:20:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 9.3 MB/s | 3.1 MB 00:00 2024-09-10T09:20:14.140 INFO:teuthology.orchestra.run.smithi012.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.2 MB/s | 146 kB 00:00 2024-09-10T09:20:14.215 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.1 MB/s | 145 kB 00:00 2024-09-10T09:20:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 10 MB/s | 3.6 MB 00:00 2024-09-10T09:20:14.541 INFO:teuthology.orchestra.run.smithi012.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.9 MB/s | 249 kB 00:00 2024-09-10T09:20:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 661 kB/s | 49 kB 00:00 2024-09-10T09:20:14.691 INFO:teuthology.orchestra.run.smithi012.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 219 kB/s | 16 kB 00:00 2024-09-10T09:20:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-10T09:20:14.842 INFO:teuthology.orchestra.run.smithi012.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 285 kB 00:00 2024-09-10T09:20:14.874 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 14 MB/s | 21 MB 00:01 2024-09-10T09:20:14.965 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-10T09:20:15.149 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 26 MB/s | 4.7 MB 00:00 2024-09-10T09:20:15.224 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 2.4 MB/s | 2.4 MB 00:01 2024-09-10T09:20:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:(37/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 18 MB/s | 49 MB 00:02 2024-09-10T09:20:15.317 INFO:teuthology.orchestra.run.smithi012.stdout:(38/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 1.5 MB/s | 766 kB 00:00 2024-09-10T09:20:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:(39/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 36 kB/s | 18 kB 00:00 2024-09-10T09:20:15.426 INFO:teuthology.orchestra.run.smithi012.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-10T09:20:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-10T09:20:15.499 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 2.5 MB/s | 5.4 MB 00:02 2024-09-10T09:20:15.502 INFO:teuthology.orchestra.run.smithi012.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T09:20:15.541 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 609 kB/s | 25 kB 00:00 2024-09-10T09:20:15.543 INFO:teuthology.orchestra.run.smithi012.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-10T09:20:15.569 INFO:teuthology.orchestra.run.smithi012.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-10T09:20:15.611 INFO:teuthology.orchestra.run.smithi012.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-10T09:20:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-10T09:20:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T09:20:15.745 INFO:teuthology.orchestra.run.smithi012.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-10T09:20:15.800 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 26 MB/s | 17 MB 00:00 2024-09-10T09:20:15.850 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 4.5 MB/s | 228 kB 00:00 2024-09-10T09:20:15.870 INFO:teuthology.orchestra.run.smithi012.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-10T09:20:15.892 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 654 kB/s | 27 kB 00:00 2024-09-10T09:20:15.896 INFO:teuthology.orchestra.run.smithi012.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 711 kB/s | 107 kB 00:00 2024-09-10T09:20:15.921 INFO:teuthology.orchestra.run.smithi012.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-10T09:20:15.934 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 760 kB/s | 32 kB 00:00 2024-09-10T09:20:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-10T09:20:15.988 INFO:teuthology.orchestra.run.smithi012.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-10T09:20:15.993 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 751 kB 00:00 2024-09-10T09:20:16.030 INFO:teuthology.orchestra.run.smithi012.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-10T09:20:16.043 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T09:20:16.055 INFO:teuthology.orchestra.run.smithi012.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-10T09:20:16.081 INFO:teuthology.orchestra.run.smithi012.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T09:20:16.093 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T09:20:16.106 INFO:teuthology.orchestra.run.smithi012.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T09:20:16.131 INFO:teuthology.orchestra.run.smithi012.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-10T09:20:16.143 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 9.9 MB/s | 506 kB 00:00 2024-09-10T09:20:16.198 INFO:teuthology.orchestra.run.smithi012.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-10T09:20:16.223 INFO:teuthology.orchestra.run.smithi012.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-10T09:20:16.249 INFO:teuthology.orchestra.run.smithi012.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-10T09:20:16.274 INFO:teuthology.orchestra.run.smithi012.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T09:20:16.299 INFO:teuthology.orchestra.run.smithi012.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T09:20:16.324 INFO:teuthology.orchestra.run.smithi012.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-10T09:20:16.344 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 27 MB/s | 5.3 MB 00:00 2024-09-10T09:20:16.349 INFO:teuthology.orchestra.run.smithi012.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-10T09:20:16.375 INFO:teuthology.orchestra.run.smithi012.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T09:20:16.385 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 1.1 MB/s | 45 kB 00:00 2024-09-10T09:20:16.436 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.7 MB/s | 136 kB 00:00 2024-09-10T09:20:16.450 INFO:teuthology.orchestra.run.smithi012.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T09:20:16.486 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 3.2 MB/s | 161 kB 00:00 2024-09-10T09:20:16.534 INFO:teuthology.orchestra.run.smithi012.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-10T09:20:16.536 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 6.3 MB/s | 320 kB 00:00 2024-09-10T09:20:16.587 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.9 MB/s | 301 kB 00:00 2024-09-10T09:20:16.601 INFO:teuthology.orchestra.run.smithi012.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-10T09:20:16.626 INFO:teuthology.orchestra.run.smithi012.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-10T09:20:16.637 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 2.0 MB/s | 99 kB 00:00 2024-09-10T09:20:16.668 INFO:teuthology.orchestra.run.smithi012.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-09-10T09:20:16.710 INFO:teuthology.orchestra.run.smithi012.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-10T09:20:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T09:20:16.737 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 852 kB/s | 85 kB 00:00 2024-09-10T09:20:16.769 INFO:teuthology.orchestra.run.smithi012.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-10T09:20:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-10T09:20:16.869 INFO:teuthology.orchestra.run.smithi012.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T09:20:16.879 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-10T09:20:16.895 INFO:teuthology.orchestra.run.smithi012.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-10T09:20:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-10T09:20:16.931 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.2 MB/s | 170 kB 00:00 2024-09-10T09:20:16.945 INFO:teuthology.orchestra.run.smithi012.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-10T09:20:16.973 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 771 kB/s | 32 kB 00:00 2024-09-10T09:20:16.979 INFO:teuthology.orchestra.run.smithi012.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T09:20:17.004 INFO:teuthology.orchestra.run.smithi012.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-10T09:20:17.024 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.9 MB/s | 146 kB 00:00 2024-09-10T09:20:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-10T09:20:17.113 INFO:teuthology.orchestra.run.smithi012.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-10T09:20:17.138 INFO:teuthology.orchestra.run.smithi012.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T09:20:17.164 INFO:teuthology.orchestra.run.smithi012.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T09:20:17.174 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 24 MB/s | 3.6 MB 00:00 2024-09-10T09:20:17.189 INFO:teuthology.orchestra.run.smithi012.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-10T09:20:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T09:20:17.248 INFO:teuthology.orchestra.run.smithi012.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T09:20:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T09:20:17.298 INFO:teuthology.orchestra.run.smithi012.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T09:20:17.324 INFO:teuthology.orchestra.run.smithi012.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T09:20:17.399 INFO:teuthology.orchestra.run.smithi012.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-10T09:20:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-10T09:20:17.433 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 4.8 MB/s | 11 MB 00:02 2024-09-10T09:20:17.449 INFO:teuthology.orchestra.run.smithi012.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-10T09:20:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T09:20:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-10T09:20:17.525 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-10T09:20:17.525 INFO:teuthology.orchestra.run.smithi012.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T09:20:17.550 INFO:teuthology.orchestra.run.smithi012.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-10T09:20:17.566 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-modules-core-19.1.1-305.g1cf 1.8 MB/s | 249 kB 00:00 2024-09-10T09:20:17.576 INFO:teuthology.orchestra.run.smithi012.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T09:20:17.600 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 659 kB/s | 49 kB 00:00 2024-09-10T09:20:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T09:20:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T09:20:17.642 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 218 kB/s | 16 kB 00:00 2024-09-10T09:20:17.652 INFO:teuthology.orchestra.run.smithi012.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-10T09:20:17.676 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 3.7 MB/s | 285 kB 00:00 2024-09-10T09:20:17.677 INFO:teuthology.orchestra.run.smithi012.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-10T09:20:17.727 INFO:teuthology.orchestra.run.smithi012.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T09:20:17.751 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 243 kB/s | 18 kB 00:00 2024-09-10T09:20:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T09:20:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-10T09:20:17.828 INFO:teuthology.orchestra.run.smithi012.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-10T09:20:17.870 INFO:teuthology.orchestra.run.smithi012.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-10T09:20:17.895 INFO:teuthology.orchestra.run.smithi012.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T09:20:17.921 INFO:teuthology.orchestra.run.smithi012.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T09:20:17.926 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 2.6 MB/s | 766 kB 00:00 2024-09-10T09:20:17.946 INFO:teuthology.orchestra.run.smithi012.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-10T09:20:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T09:20:18.047 INFO:teuthology.orchestra.run.smithi012.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T09:20:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T09:20:18.097 INFO:teuthology.orchestra.run.smithi012.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T09:20:18.122 INFO:teuthology.orchestra.run.smithi012.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-10T09:20:18.168 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-09-10T09:20:18.281 INFO:teuthology.orchestra.run.smithi012.stdout:(117/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-10T09:20:18.315 INFO:teuthology.orchestra.run.smithi012.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 895 kB/s | 172 kB 00:00 2024-09-10T09:20:18.349 INFO:teuthology.orchestra.run.smithi012.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.5 MB/s | 303 kB 00:00 2024-09-10T09:20:18.424 INFO:teuthology.orchestra.run.smithi012.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-10T09:20:18.435 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 717 kB/s | 191 kB 00:00 2024-09-10T09:20:18.474 INFO:teuthology.orchestra.run.smithi012.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-10T09:20:18.499 INFO:teuthology.orchestra.run.smithi012.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2024-09-10T09:20:18.525 INFO:teuthology.orchestra.run.smithi012.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T09:20:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-10T09:20:18.575 INFO:teuthology.orchestra.run.smithi012.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-10T09:20:18.600 INFO:teuthology.orchestra.run.smithi012.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-10T09:20:18.619 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-10T09:20:18.626 INFO:teuthology.orchestra.run.smithi012.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-10T09:20:18.651 INFO:teuthology.orchestra.run.smithi012.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T09:20:18.676 INFO:teuthology.orchestra.run.smithi012.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T09:20:18.701 INFO:teuthology.orchestra.run.smithi012.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T09:20:18.728 INFO:teuthology.orchestra.run.smithi012.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T09:20:18.760 INFO:teuthology.orchestra.run.smithi012.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T09:20:18.761 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 961 kB/s | 801 kB 00:00 2024-09-10T09:20:18.794 INFO:teuthology.orchestra.run.smithi012.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-10T09:20:18.819 INFO:teuthology.orchestra.run.smithi012.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-10T09:20:18.845 INFO:teuthology.orchestra.run.smithi012.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T09:20:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-10T09:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-10T09:20:18.895 INFO:teuthology.orchestra.run.smithi012.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T09:20:18.921 INFO:teuthology.orchestra.run.smithi012.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T09:20:18.946 INFO:teuthology.orchestra.run.smithi012.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T09:20:18.963 INFO:teuthology.orchestra.run.smithi012.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-09-10T09:20:18.986 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-09-10T09:20:19.011 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-10T09:20:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-10T09:20:19.038 INFO:teuthology.orchestra.run.smithi012.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 808 kB/s | 74 kB 00:00 2024-09-10T09:20:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T09:20:19.087 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T09:20:19.089 INFO:teuthology.orchestra.run.smithi012.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T09:20:19.114 INFO:teuthology.orchestra.run.smithi012.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-10T09:20:19.137 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-10T09:20:19.139 INFO:teuthology.orchestra.run.smithi012.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T09:20:19.173 INFO:teuthology.orchestra.run.smithi012.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T09:20:19.223 INFO:teuthology.orchestra.run.smithi012.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T09:20:19.396 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T09:20:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-10T09:20:19.429 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-10T09:20:19.454 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-10T09:20:19.471 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-10T09:20:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-10T09:20:19.522 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-10T09:20:19.541 INFO:teuthology.orchestra.run.smithi012.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 701 kB/s | 41 kB 00:00 2024-09-10T09:20:19.547 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-10T09:20:19.597 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-10T09:20:19.616 INFO:teuthology.orchestra.run.smithi012.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 3.3 MB/s | 249 kB 00:00 2024-09-10T09:20:19.648 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T09:20:19.706 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T09:20:19.757 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-10T09:20:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 3.9 MB/s | 2.3 MB 00:00 2024-09-10T09:20:19.841 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-09-10T09:20:19.858 INFO:teuthology.orchestra.run.smithi012.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.9 MB/s | 1.8 MB 00:00 2024-09-10T09:20:19.917 INFO:teuthology.orchestra.run.smithi012.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-10T09:20:20.160 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-10T09:20:20.208 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-10T09:20:20.258 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-10T09:20:20.425 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-10T09:20:20.467 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-10T09:20:20.508 INFO:teuthology.orchestra.run.smithi012.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-10T09:20:20.515 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:20:20.515 INFO:teuthology.orchestra.run.smithi012.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-10T09:20:20.517 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T09:20:20.551 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-10T09:20:21.784 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-10T09:20:21.954 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-10T09:20:21.955 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-10T09:20:22.443 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 7.1 MB/s | 49 MB 00:06 2024-09-10T09:20:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-10T09:20:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.1 MB/s | 4.9 MB 00:02 2024-09-10T09:20:22.977 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-09-10T09:20:23.002 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 823 kB/s | 137 kB 00:00 2024-09-10T09:20:23.260 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-10T09:20:23.353 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 954 kB/s | 87 kB 00:00 2024-09-10T09:20:23.561 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-10T09:20:23.620 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T09:20:23.778 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-10T09:20:23.937 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-10T09:20:23.987 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-10T09:20:24.054 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-10T09:20:24.162 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-10T09:20:24.213 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-10T09:20:24.378 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-10T09:20:24.378 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-10T09:20:25.964 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 1.9 MB/s | 5.8 MB 00:02 2024-09-10T09:20:26.130 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2024-09-10T09:20:26.189 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-09-10T09:20:26.272 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 925 kB/s | 77 kB 00:00 2024-09-10T09:20:26.298 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-10T09:20:26.323 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-10T09:20:26.431 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T09:20:26.490 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-10T09:20:26.540 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T09:20:26.591 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-09-10T09:20:26.616 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-10T09:20:26.666 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-10T09:20:26.716 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-10T09:20:26.900 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-09-10T09:20:26.925 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-09-10T09:20:26.951 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-10T09:20:26.976 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-10T09:20:27.026 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T09:20:27.110 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-10T09:20:27.135 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-10T09:20:27.185 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-10T09:20:27.210 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 634 kB/s | 64 kB 00:00 2024-09-10T09:20:27.286 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-10T09:20:27.344 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T09:20:27.378 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T09:20:27.403 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-10T09:20:27.437 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-10T09:20:27.487 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-09-10T09:20:27.521 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T09:20:27.554 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T09:20:27.588 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T09:20:27.655 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-10T09:20:27.689 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T09:20:27.714 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T09:20:27.739 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T09:20:27.765 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-10T09:20:27.798 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-10T09:20:27.823 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T09:20:27.857 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.8 MB/s | 303 kB 00:00 2024-09-10T09:20:27.882 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-10T09:20:27.908 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T09:20:27.933 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T09:20:27.958 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-10T09:20:27.983 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-10T09:20:28.009 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-10T09:20:28.034 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-10T09:20:28.059 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-10T09:20:28.101 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 25 MB/s | 1.0 MB 00:00 2024-09-10T09:20:28.126 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T09:20:28.152 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T09:20:28.202 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-09-10T09:20:28.228 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-09-10T09:20:28.253 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-10T09:20:28.278 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-10T09:20:28.303 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T09:20:28.329 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-10T09:20:28.354 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T09:20:28.379 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T09:20:28.404 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T09:20:28.430 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-10T09:20:28.455 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T09:20:28.480 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T09:20:28.522 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-10T09:20:28.548 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 795 kB/s | 20 kB 00:00 2024-09-10T09:20:28.573 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-10T09:20:28.598 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T09:20:28.657 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T09:20:29.374 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 4.4 MB/s | 3.2 MB 00:00 2024-09-10T09:20:29.800 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-09-10T09:20:29.858 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): librados2-19.1.1-305.g1cf819b7.el9.x 2.7 MB/s | 3.4 MB 00:01 2024-09-10T09:20:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 153 kB/s | 41 kB 00:00 2024-09-10T09:20:30.408 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 878 kB/s | 249 kB 00:00 2024-09-10T09:20:30.567 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-09-10T09:20:30.792 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-10T09:20:30.834 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-10T09:20:30.977 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-10T09:20:31.071 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T09:20:31.120 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T09:20:31.181 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T09:20:31.221 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T09:20:31.246 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T09:20:31.305 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T09:20:31.518 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 2.4 MB 00:00 2024-09-10T09:20:31.523 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:20:31.523 INFO:teuthology.orchestra.run.smithi100.stdout:Total 12 MB/s | 226 MB 00:18 2024-09-10T09:20:31.660 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T09:20:31.780 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:20:31.906 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:20:31.931 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:20:32.033 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:20:32.071 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:20:32.271 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T09:20:32.334 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T09:20:32.361 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:20:32.473 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:20:32.504 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:20:32.567 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:20:32.597 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:20:32.618 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:20:32.729 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-10T09:20:32.817 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:20:32.878 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-10T09:20:32.878 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-10T09:20:32.976 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:20:33.111 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T09:20:33.234 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:20:33.313 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:20:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:20:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T09:20:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T09:20:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T09:20:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T09:20:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T09:20:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T09:20:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T09:20:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T09:20:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T09:20:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T09:20:34.203 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T09:20:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T09:20:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T09:20:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T09:20:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T09:20:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T09:20:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T09:20:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T09:20:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T09:20:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T09:20:34.736 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T09:20:34.880 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T09:20:34.945 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T09:20:35.344 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-10T09:20:35.344 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-10T09:20:35.505 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T09:20:35.592 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T09:20:35.626 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T09:20:35.670 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T09:20:35.707 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T09:20:35.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T09:20:35.916 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T09:20:35.985 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T09:20:36.042 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T09:20:36.115 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T09:20:36.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T09:20:36.189 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T09:20:36.237 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T09:20:36.272 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T09:20:36.324 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T09:20:36.374 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T09:20:36.519 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T09:20:36.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T09:20:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T09:20:36.805 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T09:20:37.034 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T09:20:37.074 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T09:20:37.115 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T09:20:37.140 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T09:20:37.241 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T09:20:37.382 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T09:20:37.422 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T09:20:37.458 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T09:20:37.501 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T09:20:37.541 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T09:20:37.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T09:20:37.610 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T09:20:37.653 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T09:20:37.694 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T09:20:37.736 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T09:20:37.770 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T09:20:37.861 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T09:20:37.910 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T09:20:37.941 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T09:20:38.052 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T09:20:38.104 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T09:20:38.873 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T09:20:38.925 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T09:20:38.959 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T09:20:39.071 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T09:20:39.124 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T09:20:39.168 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T09:20:39.259 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T09:20:39.303 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T09:20:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T09:20:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T09:20:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T09:20:40.313 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T09:20:40.446 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T09:20:41.802 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T09:20:41.808 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-10T09:20:41.879 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T09:20:41.907 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T09:20:41.940 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T09:20:41.947 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T09:20:42.001 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T09:20:42.055 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T09:20:42.089 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T09:20:42.114 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T09:20:42.165 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T09:20:42.320 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T09:20:42.395 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:20:42.479 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:20:42.517 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T09:20:42.538 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T09:20:42.554 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T09:20:42.607 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:20:42.729 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:20:42.758 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:20:42.850 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:20:42.879 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:20:43.044 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T09:20:43.060 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T09:20:43.090 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:20:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T09:20:43.129 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:20:43.161 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:20:43.199 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T09:20:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:20:43.247 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:20:43.326 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:20:43.356 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:20:43.382 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:20:43.533 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:20:43.697 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:20:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T09:20:43.923 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:20:44.000 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:20:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:20:44.321 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T09:20:44.415 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T09:20:44.455 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T09:20:44.489 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T09:20:44.553 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T09:20:44.598 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T09:20:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T09:20:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T09:20:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T09:20:44.743 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T09:20:44.810 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T09:20:44.865 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T09:20:44.896 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T09:20:44.939 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T09:20:45.015 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T09:20:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T09:20:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T09:20:45.122 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T09:20:45.194 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T09:20:45.245 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T09:20:45.319 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T09:20:45.450 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T09:20:45.506 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T09:20:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:20:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:20:46.028 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T09:20:46.134 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T09:20:46.164 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T09:20:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:20:46.209 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T09:20:46.245 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T09:20:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:20:46.287 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T09:20:46.359 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:20:46.359 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:20:46.359 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:20:46.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:20:46.403 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:20:46.446 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T09:20:46.498 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T09:20:46.553 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T09:20:46.626 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T09:20:46.657 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T09:20:46.694 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T09:20:46.740 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T09:20:46.776 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T09:20:46.820 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T09:20:46.862 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T09:20:46.997 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T09:20:47.039 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T09:20:47.126 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T09:20:47.360 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T09:20:47.439 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T09:20:47.488 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T09:20:47.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T09:20:47.537 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T09:20:47.716 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T09:20:47.846 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T09:20:47.878 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T09:20:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T09:20:47.950 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T09:20:47.988 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T09:20:48.019 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T09:20:48.049 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T09:20:48.084 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T09:20:48.117 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T09:20:48.158 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T09:20:48.193 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T09:20:48.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T09:20:48.331 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T09:20:48.363 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T09:20:48.464 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T09:20:48.514 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T09:20:49.227 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T09:20:49.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T09:20:49.311 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T09:20:49.419 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T09:20:49.466 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T09:20:49.514 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T09:20:49.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T09:20:49.634 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T09:20:49.818 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T09:20:49.841 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T09:20:49.917 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T09:20:50.576 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T09:20:50.686 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T09:20:51.909 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T09:20:51.988 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T09:20:52.016 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T09:20:52.049 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T09:20:52.367 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T09:20:52.412 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:20:52.485 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:20:52.517 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T09:20:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T09:20:53.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T09:20:53.065 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:20:53.135 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:20:53.158 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T09:20:55.399 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:20:55.438 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:20:55.991 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:20:56.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:20:56.124 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:20:56.124 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:20:56.124 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:20:56.124 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:20:56.168 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-10T09:20:58.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:20:58.996 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:20:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:20:59.013 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:20:59.013 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T09:20:59.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:00.557 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:21:00.585 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:21:00.586 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:00.586 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:21:00.586 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:21:00.586 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:21:00.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:00.824 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:21:00.849 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:21:00.849 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:00.849 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:21:00.849 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:21:00.849 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:21:00.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:01.316 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:21:01.342 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:21:01.342 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:01.342 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:21:01.342 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:21:01.342 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:21:01.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T09:21:01.514 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T09:21:01.578 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T09:21:01.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T09:21:01.826 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T09:21:01.907 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T09:21:02.012 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T09:21:02.157 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T09:21:02.210 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T09:21:02.241 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T09:21:02.268 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T09:21:02.682 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:21:02.709 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:21:02.741 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T09:21:02.805 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T09:21:02.831 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:21:03.937 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:21:03.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:21:05.001 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:21:05.041 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:21:05.152 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:21:05.328 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T09:21:05.360 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:21:05.385 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:21:05.386 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:05.386 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:21:05.386 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:21:05.386 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:21:05.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:05.436 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:21:05.448 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:21:05.550 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T09:21:05.613 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T09:21:06.601 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T09:21:06.630 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:21:06.655 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:21:06.655 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:06.656 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:21:06.656 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:21:06.656 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:21:06.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:06.706 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:21:06.730 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:21:06.730 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:06.730 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:21:06.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:06.790 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:21:06.815 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:21:06.815 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:06.815 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T09:21:06.815 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:21:06.815 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:21:06.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:07.132 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:21:07.157 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:21:07.157 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:07.157 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:21:07.157 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:21:07.157 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:21:07.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:07.864 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:21:07.864 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-10T09:21:07.865 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:08.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:21:08.046 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:21:08.046 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:08.046 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T09:21:08.047 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:21:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:21:09.509 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:09.509 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:21:09.509 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:21:09.509 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:21:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:09.732 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:21:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:21:09.756 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:09.756 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:21:09.756 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:21:09.756 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:21:09.756 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:10.208 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:21:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:21:10.232 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:10.232 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:21:10.232 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:21:10.232 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:21:10.232 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:10.338 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T09:21:10.386 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T09:21:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T09:21:10.624 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T09:21:10.675 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T09:21:10.743 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T09:21:10.832 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T09:21:11.002 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T09:21:11.050 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T09:21:11.082 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T09:21:11.110 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T09:21:11.580 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:21:11.609 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:21:11.657 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T09:21:11.710 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T09:21:11.740 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:21:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T09:21:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T09:21:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T09:21:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T09:21:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T09:21:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T09:21:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T09:21:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T09:21:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T09:21:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T09:21:12.771 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:21:12.809 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:21:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:21:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:21:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:21:13.765 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:21:13.792 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:21:13.896 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:21:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T09:21:14.078 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:21:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:21:14.102 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:14.102 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:21:14.102 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:21:14.102 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:21:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T09:21:14.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:21:14.157 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:21:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T09:21:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T09:21:14.245 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T09:21:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T09:21:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T09:21:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T09:21:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T09:21:14.411 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T09:21:14.412 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:21:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:21:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:21:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:21:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T09:21:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:21:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:21:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:21:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:21:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:21:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:21:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T09:21:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:21:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:21:15.288 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:15.288 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:21:15.289 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:21:15.289 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:21:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:21:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:21:15.354 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:15.354 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:21:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:21:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:21:15.422 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:15.422 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T09:21:15.422 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:21:15.422 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:21:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:15.733 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:21:15.756 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:21:15.756 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:21:15.756 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:21:15.756 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:21:15.757 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:21:15.757 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:20.553 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T09:21:20.595 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T09:21:20.644 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:21:20.656 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T09:21:20.657 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T09:21:20.658 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T09:21:20.658 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T09:21:20.658 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T09:21:20.658 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T09:21:20.658 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T09:21:20.658 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T09:21:20.673 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T09:21:20.673 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T09:21:20.673 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T09:21:20.673 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T09:21:20.674 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T09:21:20.675 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T09:21:20.676 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T09:21:20.677 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T09:21:20.678 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T09:21:20.679 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T09:21:20.680 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T09:21:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T09:21:20.682 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T09:21:20.683 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T09:21:20.684 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T09:21:20.703 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T09:21:20.888 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T09:21:20.933 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T09:21:20.964 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T09:21:20.993 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T09:21:21.040 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T09:21:21.604 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:21:21.638 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:21:21.658 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:21:22.475 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T09:21:22.559 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T09:21:22.603 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T09:21:22.696 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T09:21:22.729 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T09:21:22.755 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T09:21:22.780 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T09:21:22.780 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:21:22.865 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:21:22.865 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:21:22.957 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:21:22.982 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T09:21:22.987 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:21:22.987 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:21:23.167 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:21:23.167 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:21:23.252 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:21:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.461 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.462 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.463 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:21:23.464 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:21:23.465 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T09:21:23.466 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:21:23.467 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:21:23.468 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T09:21:23.468 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:21:23.469 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:21:23.470 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:21:23.471 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:21:23.472 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T09:21:23.473 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:21:23.476 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T09:21:23.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:23.476 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-10T09:21:24.008 DEBUG:teuthology.parallel:result is None 2024-09-10T09:21:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:21:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T09:21:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T09:21:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T09:21:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T09:21:28.893 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T09:21:28.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T09:21:28.895 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T09:21:28.896 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T09:21:28.897 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T09:21:28.898 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T09:21:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T09:21:28.900 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T09:21:28.901 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T09:21:28.902 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T09:21:28.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T09:21:28.904 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T09:21:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T09:21:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T09:21:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T09:21:28.905 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T09:21:31.511 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:21:31.511 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T09:21:31.512 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T09:21:31.514 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:21:31.515 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:21:31.516 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:21:31.517 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T09:21:31.518 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:21:31.519 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T09:21:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:21:31.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:21:31.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.523 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:21:31.524 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:21:31.524 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:21:31.524 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:21:31.524 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T09:21:31.524 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T09:21:31.524 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:21:31.525 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T09:21:31.525 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:31.525 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-10T09:21:31.950 DEBUG:teuthology.parallel:result is None 2024-09-10T09:21:31.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:21:32.097 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:21:32.125 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T09:21:32.125 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T09:21:32.125 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T09:21:32.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:21:32.271 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:21:32.294 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T09:21:32.294 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T09:21:32.294 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T09:21:32.296 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T09:21:32.296 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:32.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:21:32.330 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:32.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:21:32.361 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T09:21:32.362 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:32.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:21:32.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:21:32.469 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:32.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:21:32.495 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:21:32.560 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T09:21:32.560 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:32.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:21:32.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:21:32.657 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:32.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:21:32.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:21:32.745 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T09:21:32.746 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:32.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:21:32.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:21:32.842 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:32.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:21:32.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:21:32.932 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T09:21:33.026 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T09:21:33.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-09-10T09:21:33.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-09-10T09:21:33.055 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T09:21:33.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T09:21:33.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T09:21:33.124 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T09:21:33.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T09:21:33.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T09:21:33.199 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T09:21:33.199 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T09:21:33.199 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T09:21:33.199 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:33.199 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T09:21:33.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T09:21:33.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T09:21:33.392 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:33.392 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T09:21:33.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T09:21:33.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T09:21:33.549 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T09:21:33.549 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T09:21:33.549 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965', 'branch': 'wip-rishabh-testing-20240909.165402-squid', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}}', 'email': None, 'first_in_suite': False, 'job_id': '7898965', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240909.165402-squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240909.165402-squid', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9893, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'sleep_before_teardown': 0, 'subset': '197/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240909.165402-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYjRbfBKONCSTDHOHSWvnGYLVbAaq2X5vLVSseP+pl/PwW58+CYMP8HNeoz7w91pSoPGCh9SMGYmXvR2vOfF/o=', 'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpKyjVGDd1s1vooGSgfdVv6u5l+xqYvLP6D8vi01TLfywI12+6FbcU+AYo0AI+dsu1I9E7iGx91/Bjx76aVrLA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_06:58:10', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T09:21:33.550 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T09:21:33.552 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T09:21:33.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T09:21:33.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T09:21:33.663 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:33.663 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T09:21:33.690 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T09:21:33.690 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-10T09:21:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 09:21:15.357455916 +0000 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 09:19:28.894956845 +0000 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 09:19:28.894956845 +0000 2024-09-10T09:21:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 09:19:28.894956845 +0000 2024-09-10T09:21:33.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T09:21:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T09:21:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T09:21:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000208516 s, 2.5 MB/s 2024-09-10T09:21:33.813 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T09:21:33.869 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-10T09:21:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T09:21:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:33.927 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T09:21:33.928 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:33.928 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:33.928 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 09:21:15.358455907 +0000 2024-09-10T09:21:33.928 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 09:19:29.249953718 +0000 2024-09-10T09:21:33.928 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 09:19:29.249953718 +0000 2024-09-10T09:21:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 09:19:29.249953718 +0000 2024-09-10T09:21:33.928 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T09:21:33.991 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T09:21:33.992 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T09:21:33.992 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00017362 s, 2.9 MB/s 2024-09-10T09:21:33.993 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T09:21:34.049 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-10T09:21:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T09:21:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:34.105 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T09:21:34.105 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:34.105 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:34.106 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 09:21:15.358455907 +0000 2024-09-10T09:21:34.106 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 09:19:29.592950697 +0000 2024-09-10T09:21:34.106 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 09:19:29.592950697 +0000 2024-09-10T09:21:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 09:19:29.592950697 +0000 2024-09-10T09:21:34.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T09:21:34.169 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T09:21:34.170 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T09:21:34.170 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000176236 s, 2.9 MB/s 2024-09-10T09:21:34.171 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T09:21:34.228 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-10 09:21:15.359455898 +0000 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-10 09:19:29.925947765 +0000 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-10 09:19:29.925947765 +0000 2024-09-10T09:21:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-10 09:19:29.925947765 +0000 2024-09-10T09:21:34.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T09:21:34.348 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-10T09:21:34.348 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-10T09:21:34.348 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000171654 s, 3.0 MB/s 2024-09-10T09:21:34.349 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T09:21:34.406 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:34.406 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:34.406 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T09:21:34.423 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T09:21:34.424 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-10T09:21:34.480 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T09:21:34.480 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 09:21:23.649572929 +0000 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 09:19:28.768970436 +0000 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 09:19:28.768970436 +0000 2024-09-10T09:21:34.481 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 09:19:28.768970436 +0000 2024-09-10T09:21:34.481 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T09:21:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T09:21:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T09:21:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000213654 s, 2.4 MB/s 2024-09-10T09:21:34.547 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T09:21:34.605 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 09:21:23.649572929 +0000 2024-09-10T09:21:34.661 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 09:19:29.086962084 +0000 2024-09-10T09:21:34.662 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 09:19:29.086962084 +0000 2024-09-10T09:21:34.662 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 09:19:29.086962084 +0000 2024-09-10T09:21:34.662 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T09:21:34.735 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T09:21:34.735 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T09:21:34.735 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000226124 s, 2.3 MB/s 2024-09-10T09:21:34.736 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T09:21:34.792 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-10T09:21:34.847 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 09:21:23.650572903 +0000 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 09:19:29.412953521 +0000 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 09:19:29.412953521 +0000 2024-09-10T09:21:34.848 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 09:19:29.412953521 +0000 2024-09-10T09:21:34.848 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T09:21:34.911 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T09:21:34.911 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T09:21:34.911 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00019013 s, 2.7 MB/s 2024-09-10T09:21:34.912 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T09:21:34.969 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-10T09:21:35.024 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 09:21:23.650572903 +0000 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 09:19:29.721945405 +0000 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 09:19:29.721945405 +0000 2024-09-10T09:21:35.025 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 09:19:29.721945405 +0000 2024-09-10T09:21:35.026 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T09:21:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T09:21:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T09:21:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000182777 s, 2.8 MB/s 2024-09-10T09:21:35.089 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T09:21:35.147 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:35.148 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T09:21:35.148 INFO:tasks.ceph:Generating config... 2024-09-10T09:21:35.149 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-10T09:21:35.149 INFO:tasks.ceph:[client] debug client = 20 2024-09-10T09:21:35.149 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T09:21:35.149 INFO:tasks.ceph:[client] pid file = 2024-09-10T09:21:35.150 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-10T09:21:35.150 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-10T09:21:35.150 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-10T09:21:35.150 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-10T09:21:35.151 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-10T09:21:35.151 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T09:21:35.151 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T09:21:35.151 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T09:21:35.151 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T09:21:35.151 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T09:21:35.151 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T09:21:35.152 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-10T09:21:35.153 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T09:21:35.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T09:21:35.209 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T09:21:35.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T09:21:35.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T09:21:35.286 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.100'), ('mon.c', '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]')] 2024-09-10T09:21:35.287 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-10T09:21:35.288 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:35.288 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T09:21:35.343 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.100 --addv c '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid b13fea51-e2df-43f6-8889-422976fa1401 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:fsid b13fea51-e2df-43f6-8889-422976fa1401 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-09-10T09:21:35.432164+0000 2024-09-10T09:21:35.432 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-10T09:21:35.432164+0000 2024-09-10T09:21:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-09-10T09:21:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-09-10T09:21:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-10T09:21:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-10T09:21:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] mon.c 2024-09-10T09:21:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T09:21:35.434 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T09:21:35.450 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b13fea51-e2df-43f6-8889-422976fa1401... 2024-09-10T09:21:35.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T09:21:35.493 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T09:21:35.535 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-10T09:21:35.535 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-09-10T09:21:35.535 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T09:21:35.535 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-09-10T09:21:35.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T09:21:35.536 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-09-10T09:21:35.537 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.538 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]" 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = b13fea51-e2df-43f6-8889-422976fa1401 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-09-10T09:21:35.539 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.540 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2024-09-10T09:21:35.541 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-09-10T09:21:35.542 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2024-09-10T09:21:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T09:21:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-09-10T09:21:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-09-10T09:21:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-09-10T09:21:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-09-10T09:21:35.544 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: debug finisher = 20 2024-09-10T09:21:35.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-10T09:21:35.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-09-10T09:21:35.547 INFO:teuthology.orchestra.run.smithi012.stdout: mon down mkfs grace = 300 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on pool no app = False 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-09-10T09:21:35.548 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = "" 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2024-09-10T09:21:35.549 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-09-10T09:21:35.550 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.552 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-09-10T09:21:35.553 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-09-10T09:21:35.554 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-09-10T09:21:35.555 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.12,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]" 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on skipped message = False 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = b13fea51-e2df-43f6-8889-422976fa1401 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.556 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.557 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-09-10T09:21:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-09-10T09:21:35.559 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-10T09:21:35.560 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: debug finisher = 20 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-09-10T09:21:35.561 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-09-10T09:21:35.562 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: mon down mkfs grace = 300 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on pool no app = False 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T09:21:35.563 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-09-10T09:21:35.564 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-09-10T09:21:35.565 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-09-10T09:21:35.566 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T09:21:35.566 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T09:21:35.648 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T09:21:35.649 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:35.649 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T09:21:35.664 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:35.665 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T09:21:35.720 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:21:35.720 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:35.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T09:21:35.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T09:21:35.796 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:21:35.796 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:35.852 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:21:35.853 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:35.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T09:21:35.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T09:21:35.888 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:21:35.888 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:35.943 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T09:21:35.944 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T09:21:35.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T09:21:35.996 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T09:21:35.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T09:21:36.094 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T09:21:36.097 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T09:21:36.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T09:21:36.150 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T09:21:36.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T09:21:36.178 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T09:21:36.271 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T09:21:36.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T09:21:36.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T09:21:36.349 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T09:21:36.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T09:21:36.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T09:21:36.467 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T09:21:36.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T09:21:36.494 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T09:21:36.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T09:21:36.536 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T09:21:36.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T09:21:36.633 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T09:21:36.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T09:21:36.686 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T09:21:36.699 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T09:21:36.782 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T09:21:36.794 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T09:21:36.794 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T09:21:36.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T09:21:36.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:36.820 INFO:tasks.ceph:role: osd.0 2024-09-10T09:21:36.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:21:36.821 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T09:21:36.893 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:36.893 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:36.893 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:36.893 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:36.893 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:36.894 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:36.894 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:36.894 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:36.894 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:36.894 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:37.408 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-10T09:21:37.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-10T09:21:37.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T09:21:37.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T09:21:37.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T09:21:37.658 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:37.658 INFO:tasks.ceph:role: osd.1 2024-09-10T09:21:37.658 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:21:37.659 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:37.745 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:37.746 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:37.746 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:37.746 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:38.195 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-10T09:21:38.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-10T09:21:38.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T09:21:38.252 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T09:21:38.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T09:21:38.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:38.350 INFO:tasks.ceph:role: osd.2 2024-09-10T09:21:38.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:21:38.350 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T09:21:38.425 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:38.425 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:38.425 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:38.425 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:38.425 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:38.425 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:38.426 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:38.426 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:38.426 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:38.426 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-10T09:21:38.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-10T09:21:38.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T09:21:39.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T09:21:39.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T09:21:39.142 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:39.142 INFO:tasks.ceph:role: osd.3 2024-09-10T09:21:39.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:21:39.143 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T09:21:39.215 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:39.216 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:39.739 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-10T09:21:39.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-10T09:21:39.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T09:21:39.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T09:21:39.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:40.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:40.015+0000 7ffa6dfae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T09:21:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:40.016+0000 7ffa6dfae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T09:21:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:40.016+0000 7ffa6dfae640 -1 bdev(0x55d3d5951800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T09:21:40.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:40.016+0000 7ffa6dfae640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T09:21:43.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T09:21:43.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:43.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:43.302+0000 7fe6a6d43640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T09:21:43.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:43.303+0000 7fe6a6d43640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T09:21:43.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:43.303+0000 7fe6a6d43640 -1 bdev(0x559f2ee05800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T09:21:43.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:43.303+0000 7fe6a6d43640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T09:21:46.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T09:21:46.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:46.353+0000 7f7745064640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T09:21:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:46.354+0000 7f7745064640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T09:21:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:46.354+0000 7f7745064640 -1 bdev(0x55707edf5800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T09:21:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:46.354+0000 7f7745064640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T09:21:49.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T09:21:49.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:49.651+0000 7fed54430640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T09:21:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:49.651+0000 7fed54430640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T09:21:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:49.652+0000 7fed54430640 -1 bdev(0x55ff3cffb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T09:21:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:21:49.652+0000 7fed54430640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T09:21:53.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T09:21:53.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T09:21:53.122 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:53.122 INFO:tasks.ceph:role: osd.4 2024-09-10T09:21:53.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:21:53.122 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T09:21:53.198 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:53.199 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:53.688 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T09:21:53.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T09:21:53.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T09:21:53.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T09:21:53.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T09:21:53.916 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:53.916 INFO:tasks.ceph:role: osd.5 2024-09-10T09:21:53.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:21:53.916 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:54.468 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T09:21:54.471 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T09:21:54.471 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T09:21:54.565 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T09:21:54.596 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T09:21:54.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:54.662 INFO:tasks.ceph:role: osd.6 2024-09-10T09:21:54.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:21:54.663 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T09:21:54.735 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:54.735 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:54.735 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:54.735 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:54.735 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:54.735 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:54.736 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:54.736 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:54.736 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:54.736 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:55.225 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T09:21:55.226 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T09:21:55.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T09:21:55.364 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T09:21:55.397 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T09:21:55.464 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T09:21:55.464 INFO:tasks.ceph:role: osd.7 2024-09-10T09:21:55.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:21:55.464 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T09:21:55.538 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T09:21:55.538 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T09:21:55.538 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T09:21:55.538 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T09:21:55.538 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T09:21:55.539 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-10T09:21:55.539 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T09:21:55.539 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T09:21:55.539 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T09:21:55.539 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T09:21:56.039 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-10T09:21:56.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-10T09:21:56.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T09:21:56.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T09:21:56.233 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:21:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:21:56.334+0000 7fd17d40f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T09:21:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:21:56.335+0000 7fd17d40f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T09:21:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:21:56.335+0000 7fd17d40f640 -1 bdev(0x56087a539800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T09:21:56.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:21:56.335+0000 7fd17d40f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T09:22:00.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T09:22:00.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:22:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:00.359+0000 7fd94fced640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T09:22:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:00.359+0000 7fd94fced640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T09:22:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:00.359+0000 7fd94fced640 -1 bdev(0x55819542f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T09:22:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:00.359+0000 7fd94fced640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T09:22:03.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:22:03.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:22:04.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T09:22:04.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:22:04.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:04.394+0000 7fd702218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T09:22:04.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:04.394+0000 7fd702218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T09:22:04.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:04.394+0000 7fd702218640 -1 bdev(0x558fed865800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T09:22:04.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:04.394+0000 7fd702218640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T09:22:08.052 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T09:22:08.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:22:08.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:08.172+0000 7f9793945640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T09:22:08.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:08.172+0000 7f9793945640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T09:22:08.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:08.172+0000 7f9793945640 -1 bdev(0x559948293800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T09:22:08.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:08.172+0000 7f9793945640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T09:22:12.069 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T09:22:12.098 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T09:22:12.099 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T09:22:12.131 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T09:22:12.202 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T09:22:12.272 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T09:22:12.341 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T09:22:12.411 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T09:22:12.479 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T09:22:12.547 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T09:22:12.577 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T09:22:12.645 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T09:22:12.712 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T09:22:12.779 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T09:22:12.845 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T09:22:12.911 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:12.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T09:22:12.977 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.977 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T09:22:12.997 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:12.998 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T09:22:13.056 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:13.056 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T09:22:13.072 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:13.072 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T09:22:13.128 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T09:22:13.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T09:22:13.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T09:22:13.171 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCfD+BmI1lmOxAAC7zRxOowhi+zudMvum5fGQ== 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+BmbzP+CBAAwak4MxQPq//XWl/jLP9zdQ== 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+BmQmkxEBAAfzlx/8S+yTQfvDPfGjk6pg== 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCkD+BmR/r6ABAA1/xgy4Vy1T+z8FVxcTW5OQ== 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCnD+BmQlEZEhAAyLfKByWZBO31IwH/4ove9g== 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-09-10T09:22:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCqD+BmsUkjFRAA73ge9siUqUMYAeWB8Wk90Q== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCtD+Bm7cXiJhAAuNPoe8s/rQR1SojOEwMb3g== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+Bm9X+pBRAABdODK09DNuIDOPpdTzevWw== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+BmkRHXFBAA00HqjesWmBbqObkCLgZixQ== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+Bm/v/mGxAANPFme0NigpsmBVgiaQEFSQ== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC0D+Bm6ZsIFBAAQNOiE4aQOGYQdOnv55mWXw== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC4D+Bmea6BFRAA6NvO7D29CtZ6jyAjhHXpTg== 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2024-09-10T09:22:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC8D+Bm30+WFxAArKJ2nwI5SWf75VkgtN6B3A== 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDAD+Bm/RNdChAAYTGmbK71EwKrQvWuZN8k3w== 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+BmiuoDIBAAv4A7F5XnNMKzCjr+tB2NaA== 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:[client.2] 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+Bmz0u/JRAAazoLOWSwIjBlUsL9BdRWwA== 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+Bm1IbvKBAA3YNX6Y21e1Rt5ciJxLsKug== 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:[client.3] 2024-09-10T09:22:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+BmfcCfLhAASaSS2dFRjnpYqgEilyVZtg== 2024-09-10T09:22:13.192 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfD+BmI1lmOxAAC7zRxOowhi+zudMvum5fGQ== 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+BmbzP+CBAAwak4MxQPq//XWl/jLP9zdQ== 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+BmQmkxEBAAfzlx/8S+yTQfvDPfGjk6pg== 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCkD+BmR/r6ABAA1/xgy4Vy1T+z8FVxcTW5OQ== 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCnD+BmQlEZEhAAyLfKByWZBO31IwH/4ove9g== 2024-09-10T09:22:13.193 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCqD+BmsUkjFRAA73ge9siUqUMYAeWB8Wk90Q== 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCtD+Bm7cXiJhAAuNPoe8s/rQR1SojOEwMb3g== 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+Bm9X+pBRAABdODK09DNuIDOPpdTzevWw== 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+BmkRHXFBAA00HqjesWmBbqObkCLgZixQ== 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+Bm/v/mGxAANPFme0NigpsmBVgiaQEFSQ== 2024-09-10T09:22:13.194 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-09-10T09:22:13.195 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC0D+Bm6ZsIFBAAQNOiE4aQOGYQdOnv55mWXw== 2024-09-10T09:22:13.195 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-09-10T09:22:13.195 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC4D+Bmea6BFRAA6NvO7D29CtZ6jyAjhHXpTg== 2024-09-10T09:22:13.195 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-09-10T09:22:13.195 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC8D+Bm30+WFxAArKJ2nwI5SWf75VkgtN6B3A== 2024-09-10T09:22:13.195 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDAD+Bm/RNdChAAYTGmbK71EwKrQvWuZN8k3w== 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+BmiuoDIBAAv4A7F5XnNMKzCjr+tB2NaA== 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+Bmz0u/JRAAazoLOWSwIjBlUsL9BdRWwA== 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+Bm1IbvKBAA3YNX6Y21e1Rt5ciJxLsKug== 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2024-09-10T09:22:13.196 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCgD+BmfcCfLhAASaSS2dFRjnpYqgEilyVZtg== 2024-09-10T09:22:13.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T09:22:13.218 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T09:22:13.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.351 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.461 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.565 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T09:22:13.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T09:22:13.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.675 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T09:22:13.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:13.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T09:22:14.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T09:22:14.226 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T09:22:14.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T09:22:14.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T09:22:14.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T09:22:14.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T09:22:14.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T09:22:14.494 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T09:22:14.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T09:22:14.584 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T09:22:14.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T09:22:14.706 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:22:14.708 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T09:22:14.761 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T09:22:14.762 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T09:22:14.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T09:22:14.764 INFO:tasks.ceph.mon.a:Started 2024-09-10T09:22:14.765 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T09:22:14.765 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T09:22:14.803 INFO:tasks.ceph.mon.b:Started 2024-09-10T09:22:14.804 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T09:22:14.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T09:22:14.806 INFO:tasks.ceph.mon.c:Started 2024-09-10T09:22:14.806 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T09:22:14.806 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T09:22:14.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T09:22:14.808 INFO:tasks.ceph.mgr.y:Started 2024-09-10T09:22:14.808 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T09:22:14.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T09:22:14.810 INFO:tasks.ceph.mgr.x:Started 2024-09-10T09:22:14.810 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T09:22:14.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T09:22:14.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.911+0000 7f5fef447640 1 Processor -- start 2024-09-10T09:22:14.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.911+0000 7f5fef447640 1 -- start start 2024-09-10T09:22:14.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fef447640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 0x7f5fe80d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:14.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fef447640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 0x7f5fe806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:14.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fef447640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe80cf9a0 con 0x7f5fe80b3290 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fef447640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe80cfcf0 con 0x7f5fe80b3d50 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fef447640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe8162210 con 0x7f5fe8161e30 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 0x7f5fe806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 0x7f5fe806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33572/0 (socket says 172.21.15.12:33572) 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fed9e4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5fe80b3290 0x7f5fe80b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48958/0 (socket says 172.21.15.12:48958) 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 -- 172.21.15.12:0/2290885798 learned_addr learned my addr 172.21.15.12:0/2290885798 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 -- 172.21.15.12:0/2290885798 >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 msgr2=0x7f5fe806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 -- 172.21.15.12:0/2290885798 >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 msgr2=0x7f5fe806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 0x7f5fe806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fec9e2640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 0x7f5fe806d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.912+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 0x7f5fe80d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.913+0000 7f5fed1e3640 1 -- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 msgr2=0x7f5fe80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T09:22:14.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.913+0000 7f5fed1e3640 1 -- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 msgr2=0x7f5fe80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T09:22:14.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.913+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 0x7f5fe80d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T09:22:14.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:14.913+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 0x7f5fe80d34a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512867502 0 0) 0x7f5fe80cf9a0 con 0x7f5fe80b3290 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003520 con 0x7f5fe80b3290 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 164451789 0 0) 0x7f5fd4003520 con 0x7f5fe80b3290 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 msgr2=0x7f5fe80d34a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.100:3300/0 conn(0x7f5fe8161e30 0x7f5fe80d34a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 msgr2=0x7f5fe806d8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 --2- 172.21.15.12:0/2290885798 >> v2:172.21.15.12:3300/0 conn(0x7f5fe80b3d50 0x7f5fe806d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe80d5210 con 0x7f5fe80b3290 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f5fe00019f0 con 0x7f5fe80b3290 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 >> v1:172.21.15.12:6789/0 conn(0x7f5fe80b3290 legacy=0x7f5fe80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fd4004800 0x7f5fd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40051c0 0x7f5fd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe80cfcf0 con 0x7f5fd40039b0 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8162210 con 0x7f5fd40051c0 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd400c0c0 con 0x7f5fd4004800 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fec9e2640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fd4004800 0x7f5fd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed9e4640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40051c0 0x7f5fd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed1e3640 1 -- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fd4004800 msgr2=0x7f5fd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fd4004800 0x7f5fd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed1e3640 1 -- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40051c0 msgr2=0x7f5fd400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40051c0 0x7f5fd400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed1e3640 1 -- 172.21.15.12:0/2290885798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd4003520 con 0x7f5fd40039b0 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.084+0000 7f5fed9e4640 1 -- 172.21.15.12:0/2290885798 reap_dead start 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.085+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400b9e0 tx=0x7f5fd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe661e14caed4828 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.085+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4030070 con 0x7f5fd40039b0 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.085+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe402ada0 con 0x7f5fd40039b0 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.085+0000 7f5fdffff640 1 -- 172.21.15.12:0/2290885798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400b5e0 con 0x7f5fd40039b0 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 -- 172.21.15.12:0/2290885798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fd40039b0 msgr2=0x7f5fd4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400b9e0 tx=0x7f5fd4005830 comp rx=0 tx=0).stop 2024-09-10T09:22:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 -- 172.21.15.12:0/2290885798 shutdown_connections 2024-09-10T09:22:15.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 --2- 172.21.15.12:0/2290885798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 -- 172.21.15.12:0/2290885798 >> 172.21.15.12:0/2290885798 conn(0x7f5fe80d1870 msgr2=0x7f5fe80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:15.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 -- 172.21.15.12:0/2290885798 shutdown_connections 2024-09-10T09:22:15.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.086+0000 7f5fef447640 1 -- 172.21.15.12:0/2290885798 wait complete. 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 Processor -- start 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 -- start start 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 0x7f5fe8158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 0x7f5fe814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe81f4650 0x7f5fe81f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe80d34a0 con 0x7f5fe815a420 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe80b3950 con 0x7f5fd40039b0 2024-09-10T09:22:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.088+0000 7f5fef447640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe80d3620 con 0x7f5fe81f4650 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 0x7f5fe814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fed1e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 0x7f5fe8158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fed1e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 0x7f5fe8158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:54974/0 (socket says 172.21.15.12:54974) 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 0x7f5fe814bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33594/0 (socket says 172.21.15.12:33594) 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fed1e3640 1 -- 172.21.15.12:0/2048189560 learned_addr learned my addr 172.21.15.12:0/2048189560 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fed9e4640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe81f4650 0x7f5fe81f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 -- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe81f4650 msgr2=0x7f5fe81f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe81f4650 0x7f5fe81f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 -- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 msgr2=0x7f5fe8158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 0x7f5fe8158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 -- 172.21.15.12:0/2048189560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe80cd310 con 0x7f5fe815a420 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fed1e3640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 0x7f5fe8158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fec9e2640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 0x7f5fe814bb60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009100 tx=0x7f5fd8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8019070 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd8015930 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe80cd5f0 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.089+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800f040 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.090+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe814c0a0 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.090+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5fd801c070 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.090+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5fd800f7c0 con 0x7f5fe815a420 2024-09-10T09:22:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.091+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe80d39b0 con 0x7f5fe815a420 2024-09-10T09:22:15.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.093+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5fd8015d20 con 0x7f5fe815a420 2024-09-10T09:22:15.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.157+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5fe815e600 con 0x7f5fe815a420 2024-09-10T09:22:15.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.159+0000 7f5fddffb640 1 -- 172.21.15.12:0/2048189560 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5fd800fa10 con 0x7f5fe815a420 2024-09-10T09:22:15.160 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-10T09:22:15.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.159+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 msgr2=0x7f5fe814bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.159+0000 7f5fef447640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 0x7f5fe814bb60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009100 tx=0x7f5fd8011a60 comp rx=0 tx=0).stop 2024-09-10T09:22:15.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 shutdown_connections 2024-09-10T09:22:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe81f4650 0x7f5fe81f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe815a420 0x7f5fe814bb60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 --2- 172.21.15.12:0/2048189560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fd40039b0 0x7f5fe8158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 >> 172.21.15.12:0/2048189560 conn(0x7f5fe80d1870 msgr2=0x7f5fe806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 shutdown_connections 2024-09-10T09:22:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:15.160+0000 7f5fef447640 1 -- 172.21.15.12:0/2048189560 wait complete. 2024-09-10T09:22:15.172 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T09:22:15.172 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T09:22:15.173 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:15.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T09:22:15.181 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:15.181+0000 7ff174d33040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T09:22:15.197 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:15.195+0000 7f91841dd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T09:22:15.198 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:15.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T09:22:15.225 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:15.222+0000 7ff174d33040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T09:22:15.240 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:15.238+0000 7f91841dd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T09:22:15.265 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:15.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T09:22:15.330 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:15.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T09:22:15.363 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:15.363+0000 7ff174d33040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T09:22:15.393 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:15.391+0000 7f91841dd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T09:22:15.396 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:15.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T09:22:15.414 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:15.414+0000 7ff174d33040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T09:22:15.421 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:15.421 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T09:22:15.447 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:15.445+0000 7f91841dd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T09:22:15.486 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:15.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T09:22:15.550 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:15.551 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T09:22:15.605 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:15.605+0000 7ff174d33040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T09:22:15.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new a1d0a496-9c65-49d2-aebf-fabbd5f3984e 0 2024-09-10T09:22:15.616 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:15.614+0000 7f91841dd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T09:22:15.721 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:15.721+0000 7ff174d33040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T09:22:15.731 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:15.729+0000 7f91841dd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T09:22:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.754+0000 7f426803c640 1 Processor -- start 2024-09-10T09:22:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.755+0000 7f426803c640 1 -- start start 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.755+0000 7f426803c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f426015c720 0x7f42600713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.755+0000 7f426803c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f42600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.755+0000 7f426803c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4260071a70 con 0x7f42600b1ca0 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f426803c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f42600b55c0 con 0x7f426015c720 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f426803c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f42600b5810 con 0x7f42600b6da0 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f426015c720 0x7f42600713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f42665d9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f42600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f426015c720 0x7f42600713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53338/0 (socket says 172.21.15.100:53338) 2024-09-10T09:22:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 -- 172.21.15.100:0/1494081513 learned_addr learned my addr 172.21.15.100:0/1494081513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f42655d7640 1 --1- 172.21.15.100:0/1494081513 >> v1:172.21.15.100:6789/0 conn(0x7f42600b1ca0 0x7f42600b62f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48548/0 (socket says 172.21.15.100:48548) 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 -- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 msgr2=0x7f42600b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 --2- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f42600b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 -- 172.21.15.100:0/1494081513 >> v1:172.21.15.100:6789/0 conn(0x7f42600b1ca0 legacy=0x7f42600b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4264dd6640 1 -- 172.21.15.100:0/1494081513 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483513254 0 0) 0x7f4260071a70 con 0x7f42600b1ca0 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f4265dd8640 1 -- 172.21.15.100:0/1494081513 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42600b5af0 con 0x7f426015c720 2024-09-10T09:22:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.756+0000 7f42665d9640 1 --2- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f42600b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.757+0000 7f4265dd8640 1 --2- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f42600713e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88de65c15e908cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.757+0000 7f4264dd6640 1 -- 172.21.15.100:0/1494081513 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c037070 con 0x7f426015c720 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.757+0000 7f4264dd6640 1 -- 172.21.15.100:0/1494081513 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c032440 con 0x7f426015c720 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.757+0000 7f4264dd6640 1 -- 172.21.15.100:0/1494081513 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c032810 con 0x7f426015c720 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 -- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 msgr2=0x7f42600713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 --2- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f42600713e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c02a250 comp rx=0 tx=0).stop 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 -- 172.21.15.100:0/1494081513 shutdown_connections 2024-09-10T09:22:15.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 --2- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f42600b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 --2- 172.21.15.100:0/1494081513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f42600713e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 -- 172.21.15.100:0/1494081513 >> 172.21.15.100:0/1494081513 conn(0x7f42600d2550 msgr2=0x7f42600d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:15.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 -- 172.21.15.100:0/1494081513 shutdown_connections 2024-09-10T09:22:15.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.758+0000 7f426803c640 1 -- 172.21.15.100:0/1494081513 wait complete. 2024-09-10T09:22:15.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.759+0000 7f426803c640 1 Processor -- start 2024-09-10T09:22:15.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.759+0000 7f426803c640 1 -- start start 2024-09-10T09:22:15.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f426803c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42600b1ca0 0x7f4260147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f426803c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f4260158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f426803c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f4260155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f426803c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42600b6a00 con 0x7f42600b1ca0 2024-09-10T09:22:15.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f426803c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f42600d2290 con 0x7f426015c720 2024-09-10T09:22:15.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f426803c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f42600b6b80 con 0x7f42600b6da0 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f4260158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42665d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f4260155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f4260158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45036/0 (socket says 172.21.15.100:45036) 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 -- 172.21.15.100:0/3087079081 learned_addr learned my addr 172.21.15.100:0/3087079081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f4265dd8640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42600b1ca0 0x7f4260147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 -- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 msgr2=0x7f4260155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f4260155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 -- 172.21.15.100:0/3087079081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42600b1ca0 msgr2=0x7f4260147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42600b1ca0 0x7f4260147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.760+0000 7f42655d7640 1 -- 172.21.15.100:0/3087079081 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4260157a20 con 0x7f42600b6da0 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.761+0000 7f42655d7640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f4260158a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f425000c4d0 tx=0x7f425000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:15.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.761+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42500074e0 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.761+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42500047e0 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.761+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4260157cc0 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.761+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250004bd0 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.761+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4260158280 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.762+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4250011070 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.762+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4250013700 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.762+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42600713e0 con 0x7f42600b6da0 2024-09-10T09:22:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.764+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4250004d70 con 0x7f42600b6da0 2024-09-10T09:22:15.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.833+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a1d0a496-9c65-49d2-aebf-fabbd5f3984e", "id": 0} v 0) -- 0x7f426015f990 con 0x7f42600b6da0 2024-09-10T09:22:15.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.839+0000 7f42567fc640 1 -- 172.21.15.100:0/3087079081 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1d0a496-9c65-49d2-aebf-fabbd5f3984e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4250013a20 con 0x7f42600b6da0 2024-09-10T09:22:15.840 INFO:teuthology.orchestra.run.smithi100.stdout:0 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 msgr2=0x7f4260158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f4260158a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f425000c4d0 tx=0x7f425000c8d0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 shutdown_connections 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f426015c720 0x7f4260155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42600b6da0 0x7f4260158a80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 --2- 172.21.15.100:0/3087079081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42600b1ca0 0x7f4260147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 >> 172.21.15.100:0/3087079081 conn(0x7f42600d2550 msgr2=0x7f42600707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 shutdown_connections 2024-09-10T09:22:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.840+0000 7f426803c640 1 -- 172.21.15.100:0/3087079081 wait complete. 2024-09-10T09:22:15.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 50362240-d0e8-4735-af5c-c60ecd6e99fd 1 2024-09-10T09:22:15.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.948+0000 7fa110a77640 1 Processor -- start 2024-09-10T09:22:15.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.948+0000 7fa110a77640 1 -- start start 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa110a77640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa10c15c420 0x7fa10c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa110a77640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c06da10 con 0x7fa10c06d2c0 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa110a77640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c06dcd0 con 0x7fa10c0d0160 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa110a77640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa10c06dfb0 con 0x7fa10c15c420 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa10a59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa10c15c420 0x7fa10c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa103fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa10c0d0160 0x7fa10c06cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48552/0 (socket says 172.21.15.100:48552) 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.949+0000 7fa103fff640 1 -- 172.21.15.100:0/3615709251 learned_addr learned my addr 172.21.15.100:0/3615709251 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-10T09:22:15.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.950+0000 7fa10a59c640 1 -- 172.21.15.100:0/3615709251 >> v1:172.21.15.100:6789/0 conn(0x7fa10c0d0160 legacy=0x7fa10c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.950+0000 7fa10a59c640 1 -- 172.21.15.100:0/3615709251 >> v1:172.21.15.12:6789/0 conn(0x7fa10c06d2c0 legacy=0x7fa10c15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.950+0000 7fa109d9b640 1 -- 172.21.15.100:0/3615709251 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862244495 0 0) 0x7fa10c06dcd0 con 0x7fa10c0d0160 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.950+0000 7fa10a59c640 1 -- 172.21.15.100:0/3615709251 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c0cec00 con 0x7fa10c15c420 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.950+0000 7fa10a59c640 1 --2- 172.21.15.100:0/3615709251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c0cf6e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa10c06e130 tx=0x7fa0fc02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=800e0f79b5fdf484 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa109d9b640 1 -- 172.21.15.100:0/3615709251 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc037070 con 0x7fa10c15c420 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa109d9b640 1 -- 172.21.15.100:0/3615709251 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0fc032440 con 0x7fa10c15c420 2024-09-10T09:22:15.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa109d9b640 1 -- 172.21.15.100:0/3615709251 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc032810 con 0x7fa10c15c420 2024-09-10T09:22:15.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 -- 172.21.15.100:0/3615709251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 msgr2=0x7fa10c0cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 --2- 172.21.15.100:0/3615709251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c0cf6e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa10c06e130 tx=0x7fa0fc02a210 comp rx=0 tx=0).stop 2024-09-10T09:22:15.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 -- 172.21.15.100:0/3615709251 shutdown_connections 2024-09-10T09:22:15.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 --2- 172.21.15.100:0/3615709251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c0cf6e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 -- 172.21.15.100:0/3615709251 >> 172.21.15.100:0/3615709251 conn(0x7fa10c0cdb80 msgr2=0x7fa10c0cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:15.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 -- 172.21.15.100:0/3615709251 shutdown_connections 2024-09-10T09:22:15.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.951+0000 7fa110a77640 1 -- 172.21.15.100:0/3615709251 wait complete. 2024-09-10T09:22:15.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 Processor -- start 2024-09-10T09:22:15.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 -- start start 2024-09-10T09:22:15.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10c06d2c0 0x7fa10c1f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 0x7fa10c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c1f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c0d05b0 con 0x7fa10c06d2c0 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c0cf1c0 con 0x7fa10c15c420 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa110a77640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa10c0738d0 con 0x7fa10c0d0160 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.953+0000 7fa103fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 0x7fa10c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa10ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c1f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 0x7fa10c06c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45040/0 (socket says 172.21.15.100:45040) 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 -- 172.21.15.100:0/2119443441 learned_addr learned my addr 172.21.15.100:0/2119443441 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa10a59c640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10c06d2c0 0x7fa10c1f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 -- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 msgr2=0x7fa10c1f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c1f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 -- 172.21.15.100:0/2119443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10c06d2c0 msgr2=0x7fa10c1f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10c06d2c0 0x7fa10c1f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 -- 172.21.15.100:0/2119443441 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c1f8140 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa10ad9d640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c1f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa103fff640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 0x7fa10c06c3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c4a0 tx=0x7fa0f400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4018070 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f40074e0 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4004a20 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c1f8420 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c0b3f40 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0f401b070 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.954+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa0f40127b0 con 0x7fa10c0d0160 2024-09-10T09:22:15.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.955+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c0cf6e0 con 0x7fa10c0d0160 2024-09-10T09:22:15.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:15.957+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa0f401d440 con 0x7fa10c0d0160 2024-09-10T09:22:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.026+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "50362240-d0e8-4735-af5c-c60ecd6e99fd", "id": 1} v 0) -- 0x7fa10c159eb0 con 0x7fa10c0d0160 2024-09-10T09:22:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.034+0000 7fa102ffd640 1 -- 172.21.15.100:0/2119443441 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50362240-d0e8-4735-af5c-c60ecd6e99fd", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa0f401d7b0 con 0x7fa10c0d0160 2024-09-10T09:22:16.035 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 msgr2=0x7fa10c06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 0x7fa10c06c3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c4a0 tx=0x7fa0f400c960 comp rx=0 tx=0).stop 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 shutdown_connections 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa10c15c420 0x7fa10c1f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa10c0d0160 0x7fa10c06c3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 --2- 172.21.15.100:0/2119443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10c06d2c0 0x7fa10c1f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 >> 172.21.15.100:0/2119443441 conn(0x7fa10c0cdb80 msgr2=0x7fa10c06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 shutdown_connections 2024-09-10T09:22:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.035+0000 7fa110a77640 1 -- 172.21.15.100:0/2119443441 wait complete. 2024-09-10T09:22:16.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 2b025bd4-4ff3-4ad8-a82e-b38dec82f142 2 2024-09-10T09:22:16.068 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:16.068+0000 7ff174d33040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T09:22:16.070 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:16.068+0000 7f91841dd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T09:22:16.119 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:16.119+0000 7ff174d33040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T09:22:16.130 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:16.128+0000 7f91841dd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T09:22:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.146+0000 7f68d98e4640 1 Processor -- start 2024-09-10T09:22:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.146+0000 7f68d98e4640 1 -- start start 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d98e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d415c5b0 0x7f68d40cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d98e4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68d40d02d0 con 0x7f68d40b5190 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d98e4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68d40d05b0 con 0x7f68d4062630 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d98e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f68d40d0890 con 0x7f68d415c5b0 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d27fc640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f68d4062630 0x7f68d415d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48554/0 (socket says 172.21.15.100:48554) 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d2ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d415c5b0 0x7f68d40cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d27fc640 1 -- 172.21.15.100:0/4129501580 learned_addr learned my addr 172.21.15.100:0/4129501580 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-10T09:22:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d2ffd640 1 -- 172.21.15.100:0/4129501580 >> v1:172.21.15.100:6789/0 conn(0x7f68d4062630 legacy=0x7f68d415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d2ffd640 1 -- 172.21.15.100:0/4129501580 >> v1:172.21.15.12:6789/0 conn(0x7f68d40b5190 legacy=0x7f68d406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d1ffb640 1 -- 172.21.15.100:0/4129501580 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832517270 0 0) 0x7f68d40d05b0 con 0x7f68d4062630 2024-09-10T09:22:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.147+0000 7f68d2ffd640 1 -- 172.21.15.100:0/4129501580 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d415cdf0 con 0x7f68d415c5b0 2024-09-10T09:22:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.148+0000 7f68d2ffd640 1 --2- 172.21.15.100:0/4129501580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d415c5b0 0x7f68d40cfcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68c40097d0 tx=0x7f68c402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a511b94248ef0996 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.148+0000 7f68d1ffb640 1 -- 172.21.15.100:0/4129501580 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4037070 con 0x7f68d415c5b0 2024-09-10T09:22:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.148+0000 7f68d1ffb640 1 -- 172.21.15.100:0/4129501580 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c4032440 con 0x7f68d415c5b0 2024-09-10T09:22:16.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.148+0000 7f68d1ffb640 1 -- 172.21.15.100:0/4129501580 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4032810 con 0x7f68d415c5b0 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 -- 172.21.15.100:0/4129501580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d415c5b0 msgr2=0x7f68d40cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 --2- 172.21.15.100:0/4129501580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d415c5b0 0x7f68d40cfcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68c40097d0 tx=0x7f68c402a210 comp rx=0 tx=0).stop 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 -- 172.21.15.100:0/4129501580 shutdown_connections 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 --2- 172.21.15.100:0/4129501580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d415c5b0 0x7f68d40cfcd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 -- 172.21.15.100:0/4129501580 >> 172.21.15.100:0/4129501580 conn(0x7f68d406cae0 msgr2=0x7f68d406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 -- 172.21.15.100:0/4129501580 shutdown_connections 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.149+0000 7f68d98e4640 1 -- 172.21.15.100:0/4129501580 wait complete. 2024-09-10T09:22:16.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.150+0000 7f68d98e4640 1 Processor -- start 2024-09-10T09:22:16.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.150+0000 7f68d98e4640 1 -- start start 2024-09-10T09:22:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d98e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 0x7f68d40af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d98e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b5190 0x7f68d40aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d98e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d415c5b0 0x7f68d40ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d98e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f68d415c990 con 0x7f68d40b5190 2024-09-10T09:22:16.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d98e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68d4070030 con 0x7f68d415c5b0 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d98e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f68d415cb10 con 0x7f68d4062630 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d2ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 0x7f68d40af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d2ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 0x7f68d40af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45060/0 (socket says 172.21.15.100:45060) 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d2ffd640 1 -- 172.21.15.100:0/3876955959 learned_addr learned my addr 172.21.15.100:0/3876955959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d415c5b0 0x7f68d40ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.151+0000 7f68d27fc640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b5190 0x7f68d40aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d2ffd640 1 -- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d415c5b0 msgr2=0x7f68d40ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d2ffd640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d415c5b0 0x7f68d40ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d2ffd640 1 -- 172.21.15.100:0/3876955959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b5190 msgr2=0x7f68d40aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d2ffd640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b5190 0x7f68d40aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d2ffd640 1 -- 172.21.15.100:0/3876955959 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d40af540 con 0x7f68d4062630 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d37fe640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d415c5b0 0x7f68d40ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:16.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d2ffd640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 0x7f68d40af000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68c4035040 tx=0x7f68c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4042020 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c4030990 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d41527a0 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4037040 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d40aba30 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68c4045020 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.152+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f68c4030d80 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.153+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d40cf8b0 con 0x7f68d4062630 2024-09-10T09:22:16.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.155+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f68d40cf8b0 con 0x7f68d4062630 2024-09-10T09:22:16.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.225+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2b025bd4-4ff3-4ad8-a82e-b38dec82f142", "id": 2} v 0) -- 0x7f68d40b0700 con 0x7f68d4062630 2024-09-10T09:22:16.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68bbfff640 1 -- 172.21.15.100:0/3876955959 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b025bd4-4ff3-4ad8-a82e-b38dec82f142", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f68c404c030 con 0x7f68d4062630 2024-09-10T09:22:16.231 INFO:teuthology.orchestra.run.smithi100.stdout:2 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 msgr2=0x7f68d40af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 0x7f68d40af000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68c4035040 tx=0x7f68c40046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 shutdown_connections 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d415c5b0 0x7f68d40ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68d40b5190 0x7f68d40aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 --2- 172.21.15.100:0/3876955959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68d4062630 0x7f68d40af000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.231+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 >> 172.21.15.100:0/3876955959 conn(0x7f68d406cae0 msgr2=0x7f68d415f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.232+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 shutdown_connections 2024-09-10T09:22:16.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.232+0000 7f68d98e4640 1 -- 172.21.15.100:0/3876955959 wait complete. 2024-09-10T09:22:16.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new c1d66922-19a7-4667-9e98-24558ef3f837 3 2024-09-10T09:22:16.278 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:16.278+0000 7ff174d33040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T09:22:16.288 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:16.287+0000 7f91841dd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T09:22:16.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.376+0000 7f5c2b5d6640 1 Processor -- start 2024-09-10T09:22:16.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.376+0000 7f5c2b5d6640 1 -- start start 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c2b5d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 0x7f5c2406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c2b5d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 0x7f5c240afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c2b5d6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c2406c4c0 con 0x7f5c240afa20 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c2b5d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5c240b03a0 con 0x7f5c2406bba0 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c2b5d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5c240b4250 con 0x7f5c240b5770 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29372640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 0x7f5c2406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29b73640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 0x7f5c240afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29372640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 0x7f5c2406bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53394/0 (socket says 172.21.15.100:53394) 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29372640 1 -- 172.21.15.100:0/1907962978 learned_addr learned my addr 172.21.15.100:0/1907962978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29b73640 1 --2- 172.21.15.100:0/1907962978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 0x7f5c240afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45062/0 (socket says 172.21.15.100:45062) 2024-09-10T09:22:16.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c28b71640 1 --1- 172.21.15.100:0/1907962978 >> v1:172.21.15.100:6789/0 conn(0x7f5c240afa20 0x7f5c240b5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48566/0 (socket says 172.21.15.100:48566) 2024-09-10T09:22:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29b73640 1 -- 172.21.15.100:0/1907962978 >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 msgr2=0x7f5c2406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29b73640 1 --2- 172.21.15.100:0/1907962978 >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 0x7f5c2406bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29b73640 1 -- 172.21.15.100:0/1907962978 >> v1:172.21.15.100:6789/0 conn(0x7f5c240afa20 legacy=0x7f5c240b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29b73640 1 -- 172.21.15.100:0/1907962978 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c240ae980 con 0x7f5c240b5770 2024-09-10T09:22:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c1bfff640 1 -- 172.21.15.100:0/1907962978 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208867667 0 0) 0x7f5c2406c4c0 con 0x7f5c240afa20 2024-09-10T09:22:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.377+0000 7f5c29372640 1 --2- 172.21.15.100:0/1907962978 >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 0x7f5c2406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.378+0000 7f5c29b73640 1 --2- 172.21.15.100:0/1907962978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 0x7f5c240afe60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009d90 tx=0x7f5c1c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7091d33b2941441 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.378+0000 7f5c1bfff640 1 -- 172.21.15.100:0/1907962978 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007740 con 0x7f5c240b5770 2024-09-10T09:22:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.378+0000 7f5c1bfff640 1 -- 172.21.15.100:0/1907962978 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c0078e0 con 0x7f5c240b5770 2024-09-10T09:22:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.378+0000 7f5c1bfff640 1 -- 172.21.15.100:0/1907962978 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007cb0 con 0x7f5c240b5770 2024-09-10T09:22:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/1907962978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 msgr2=0x7f5c240afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/1907962978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 0x7f5c240afe60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009d90 tx=0x7f5c1c02a660 comp rx=0 tx=0).stop 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/1907962978 shutdown_connections 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/1907962978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240b5770 0x7f5c240afe60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/1907962978 >> v2:172.21.15.100:3300/0 conn(0x7f5c2406bba0 0x7f5c2406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/1907962978 >> 172.21.15.100:0/1907962978 conn(0x7f5c240b3380 msgr2=0x7f5c240b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/1907962978 shutdown_connections 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.379+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/1907962978 wait complete. 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.380+0000 7f5c2b5d6640 1 Processor -- start 2024-09-10T09:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.380+0000 7f5c2b5d6640 1 -- start start 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c2b5d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2406bba0 0x7f5c2415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c2b5d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 0x7f5c2415fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c2b5d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c240b5770 0x7f5c24143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c2b5d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240af220 con 0x7f5c240b5770 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c2b5d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240aef40 con 0x7f5c2406bba0 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c2b5d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5c241483e0 con 0x7f5c240afa20 2024-09-10T09:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c28b71640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 0x7f5c2415fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2406bba0 0x7f5c2415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c28b71640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 0x7f5c2415fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45068/0 (socket says 172.21.15.100:45068) 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c28b71640 1 -- 172.21.15.100:0/417155498 learned_addr learned my addr 172.21.15.100:0/417155498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29b73640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c240b5770 0x7f5c24143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 -- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 msgr2=0x7f5c2415fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 0x7f5c2415fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 -- 172.21.15.100:0/417155498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c240b5770 msgr2=0x7f5c24143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c240b5770 0x7f5c24143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 -- 172.21.15.100:0/417155498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c24160600 con 0x7f5c2406bba0 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c28b71640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 0x7f5c2415fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.381+0000 7f5c29372640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2406bba0 0x7f5c2415e090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400e900 tx=0x7f5c1400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400ca00 con 0x7f5c2406bba0 2024-09-10T09:22:16.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1400cba0 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14004030 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c24140c40 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c14003610 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c241411c0 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.382+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5c14013470 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.383+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c240afe60 con 0x7f5c2406bba0 2024-09-10T09:22:16.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.385+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5c14017020 con 0x7f5c2406bba0 2024-09-10T09:22:16.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.454+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1d66922-19a7-4667-9e98-24558ef3f837", "id": 3} v 0) -- 0x7f5c24162ca0 con 0x7f5c2406bba0 2024-09-10T09:22:16.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.459+0000 7f5c19ffb640 1 -- 172.21.15.100:0/417155498 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1d66922-19a7-4667-9e98-24558ef3f837", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5c14003ae0 con 0x7f5c2406bba0 2024-09-10T09:22:16.460 INFO:teuthology.orchestra.run.smithi100.stdout:3 2024-09-10T09:22:16.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2406bba0 msgr2=0x7f5c2415e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2406bba0 0x7f5c2415e090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400e900 tx=0x7f5c1400edc0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 shutdown_connections 2024-09-10T09:22:16.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c240b5770 0x7f5c24143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c240afa20 0x7f5c2415fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 --2- 172.21.15.100:0/417155498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2406bba0 0x7f5c2415e090 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.460+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 >> 172.21.15.100:0/417155498 conn(0x7f5c240b3380 msgr2=0x7f5c240b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.461+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 shutdown_connections 2024-09-10T09:22:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.461+0000 7f5c2b5d6640 1 -- 172.21.15.100:0/417155498 wait complete. 2024-09-10T09:22:16.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new fb600a79-7e6f-4a18-aed4-6c89f9cd7b05 4 2024-09-10T09:22:16.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.569+0000 7fca64b18640 1 Processor -- start 2024-09-10T09:22:16.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.569+0000 7fca64b18640 1 -- start start 2024-09-10T09:22:16.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.570+0000 7fca64b18640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca60155bb0 0x7fca6015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.570+0000 7fca64b18640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fca6006fda0 0x7fca60070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.570+0000 7fca64b18640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6015c7b0 con 0x7fca6015ba80 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.570+0000 7fca64b18640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fca60070740 con 0x7fca6006fda0 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.570+0000 7fca64b18640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fca600cf770 con 0x7fca60155bb0 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5dd9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fca6006fda0 0x7fca60070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5e59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca60155bb0 0x7fca6015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5ed9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fca6015ba80 0x7fca6015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48574/0 (socket says 172.21.15.100:48574) 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5ed9d640 1 -- 172.21.15.100:0/1633280257 learned_addr learned my addr 172.21.15.100:0/1633280257 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5dd9b640 1 -- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca60155bb0 msgr2=0x7fca6015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5dd9b640 1 --2- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca60155bb0 0x7fca6015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5dd9b640 1 -- 172.21.15.100:0/1633280257 >> v1:172.21.15.100:6789/0 conn(0x7fca6015ba80 legacy=0x7fca6015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5dd9b640 1 -- 172.21.15.100:0/1633280257 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca600cfa50 con 0x7fca6006fda0 2024-09-10T09:22:16.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5e59c640 1 --2- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca60155bb0 0x7fca6015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:16.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.571+0000 7fca5dd9b640 1 --2- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6006fda0 0x7fca60070200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e92dc5b9d36cd570 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca5d59a640 1 -- 172.21.15.100:0/1633280257 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50037070 con 0x7fca6006fda0 2024-09-10T09:22:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca5d59a640 1 -- 172.21.15.100:0/1633280257 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca50032440 con 0x7fca6006fda0 2024-09-10T09:22:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca5d59a640 1 -- 172.21.15.100:0/1633280257 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50032810 con 0x7fca6006fda0 2024-09-10T09:22:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 -- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6006fda0 msgr2=0x7fca60070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 --2- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6006fda0 0x7fca60070200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a180 comp rx=0 tx=0).stop 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 -- 172.21.15.100:0/1633280257 shutdown_connections 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 --2- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6006fda0 0x7fca60070200 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 --2- 172.21.15.100:0/1633280257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca60155bb0 0x7fca6015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 -- 172.21.15.100:0/1633280257 >> 172.21.15.100:0/1633280257 conn(0x7fca600b3380 msgr2=0x7fca600b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 -- 172.21.15.100:0/1633280257 shutdown_connections 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.572+0000 7fca64b18640 1 -- 172.21.15.100:0/1633280257 wait complete. 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 Processor -- start 2024-09-10T09:22:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 -- start start 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca6006fda0 0x7fca601e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca60155bb0 0x7fca600b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca6015ba80 0x7fca60147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca6015e030 con 0x7fca6006fda0 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca600cf480 con 0x7fca60155bb0 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca64b18640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fca6015e1b0 con 0x7fca6015ba80 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca5dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca60155bb0 0x7fca600b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca5ed9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca6015ba80 0x7fca60147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca5dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca60155bb0 0x7fca600b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53414/0 (socket says 172.21.15.100:53414) 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.574+0000 7fca5dd9b640 1 -- 172.21.15.100:0/1054826447 learned_addr learned my addr 172.21.15.100:0/1054826447 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca5ed9d640 1 -- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca60155bb0 msgr2=0x7fca600b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca5ed9d640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca60155bb0 0x7fca600b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca5ed9d640 1 -- 172.21.15.100:0/1054826447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca6006fda0 msgr2=0x7fca601e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca5ed9d640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca6006fda0 0x7fca601e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca5ed9d640 1 -- 172.21.15.100:0/1054826447 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca601e5390 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca5ed9d640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca6015ba80 0x7fca60147eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca5800cad0 tx=0x7fca5800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58017070 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5800ab70 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca601e5670 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58012400 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca601e5c30 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca5801a070 con 0x7fca6015ba80 2024-09-10T09:22:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.575+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fca5801cce0 con 0x7fca6015ba80 2024-09-10T09:22:16.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.576+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca60070200 con 0x7fca6015ba80 2024-09-10T09:22:16.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.578+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fca5801c790 con 0x7fca6015ba80 2024-09-10T09:22:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.648+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb600a79-7e6f-4a18-aed4-6c89f9cd7b05", "id": 4} v 0) -- 0x7fca600ce220 con 0x7fca6015ba80 2024-09-10T09:22:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.654+0000 7fca56ffd640 1 -- 172.21.15.100:0/1054826447 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb600a79-7e6f-4a18-aed4-6c89f9cd7b05", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fca5801c970 con 0x7fca6015ba80 2024-09-10T09:22:16.655 INFO:teuthology.orchestra.run.smithi100.stdout:4 2024-09-10T09:22:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca6015ba80 msgr2=0x7fca60147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca6015ba80 0x7fca60147eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca5800cad0 tx=0x7fca5800cf90 comp rx=0 tx=0).stop 2024-09-10T09:22:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 shutdown_connections 2024-09-10T09:22:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fca6015ba80 0x7fca60147eb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca60155bb0 0x7fca600b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 --2- 172.21.15.100:0/1054826447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca6006fda0 0x7fca601e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 >> 172.21.15.100:0/1054826447 conn(0x7fca600b3380 msgr2=0x7fca600af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 shutdown_connections 2024-09-10T09:22:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.655+0000 7fca64b18640 1 -- 172.21.15.100:0/1054826447 wait complete. 2024-09-10T09:22:16.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new b9c37d23-c62c-47da-8357-767f81e5740d 5 2024-09-10T09:22:16.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.764+0000 7fdeda35b640 1 Processor -- start 2024-09-10T09:22:16.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.764+0000 7fdeda35b640 1 -- start start 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fdeda35b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded415c670 0x7fded40b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fdeda35b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fded4070ba0 0x7fded40d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fdeda35b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded40d0e30 con 0x7fded40cfb00 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fdeda35b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fded415ca50 con 0x7fded4070ba0 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fdeda35b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fded4160c20 con 0x7fded415c670 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded415c670 0x7fded40b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded37fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fded40cfb00 0x7fded40b18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48582/0 (socket says 172.21.15.100:48582) 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded37fe640 1 -- 172.21.15.100:0/2897863479 learned_addr learned my addr 172.21.15.100:0/2897863479 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded88f8640 1 --2- 172.21.15.100:0/2897863479 >> v2:172.21.15.12:3300/0 conn(0x7fded4070ba0 0x7fded40d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded3fff640 1 -- 172.21.15.100:0/2897863479 >> v2:172.21.15.12:3300/0 conn(0x7fded4070ba0 msgr2=0x7fded40d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded3fff640 1 --2- 172.21.15.100:0/2897863479 >> v2:172.21.15.12:3300/0 conn(0x7fded4070ba0 0x7fded40d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded2ffd640 1 -- 172.21.15.100:0/2897863479 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002677066 0 0) 0x7fded40d0e30 con 0x7fded40cfb00 2024-09-10T09:22:16.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded3fff640 1 -- 172.21.15.100:0/2897863479 >> v1:172.21.15.100:6789/0 conn(0x7fded40cfb00 legacy=0x7fded40b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded3fff640 1 -- 172.21.15.100:0/2897863479 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded40b1ff0 con 0x7fded415c670 2024-09-10T09:22:16.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.765+0000 7fded88f8640 1 --2- 172.21.15.100:0/2897863479 >> v2:172.21.15.12:3300/0 conn(0x7fded4070ba0 0x7fded40d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.766+0000 7fded3fff640 1 --2- 172.21.15.100:0/2897863479 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded415c670 0x7fded40b5910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdec40097d0 tx=0x7fdec402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd7468851525fabd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.766+0000 7fded2ffd640 1 -- 172.21.15.100:0/2897863479 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4037070 con 0x7fded415c670 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.766+0000 7fded2ffd640 1 -- 172.21.15.100:0/2897863479 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec4032440 con 0x7fded415c670 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.766+0000 7fded2ffd640 1 -- 172.21.15.100:0/2897863479 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4032810 con 0x7fded415c670 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 -- 172.21.15.100:0/2897863479 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded415c670 msgr2=0x7fded40b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 --2- 172.21.15.100:0/2897863479 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded415c670 0x7fded40b5910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdec40097d0 tx=0x7fdec402a1c0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 -- 172.21.15.100:0/2897863479 shutdown_connections 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 --2- 172.21.15.100:0/2897863479 >> v2:172.21.15.12:3300/0 conn(0x7fded4070ba0 0x7fded40d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 --2- 172.21.15.100:0/2897863479 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded415c670 0x7fded40b5910 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 -- 172.21.15.100:0/2897863479 >> 172.21.15.100:0/2897863479 conn(0x7fded40cf010 msgr2=0x7fded40cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 -- 172.21.15.100:0/2897863479 shutdown_connections 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.767+0000 7fdeda35b640 1 -- 172.21.15.100:0/2897863479 wait complete. 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.768+0000 7fdeda35b640 1 Processor -- start 2024-09-10T09:22:16.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.768+0000 7fdeda35b640 1 -- start start 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fdeda35b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 0x7fded4151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fdeda35b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fded40cfb00 0x7fded40b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fdeda35b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded415c670 0x7fded40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fdeda35b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fded4071210 con 0x7fded40cfb00 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fdeda35b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fded4160f00 con 0x7fded415c670 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fdeda35b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fded4071390 con 0x7fded4070ba0 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 0x7fded4151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded88f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded415c670 0x7fded40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 0x7fded4151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45122/0 (socket says 172.21.15.100:45122) 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 -- 172.21.15.100:0/3660586921 learned_addr learned my addr 172.21.15.100:0/3660586921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded37fe640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fded40cfb00 0x7fded40b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 -- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded415c670 msgr2=0x7fded40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded415c670 0x7fded40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 -- 172.21.15.100:0/3660586921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fded40cfb00 msgr2=0x7fded40b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fded40cfb00 0x7fded40b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 -- 172.21.15.100:0/3660586921 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded4152730 con 0x7fded4070ba0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded88f8640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded415c670 0x7fded40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.769+0000 7fded3fff640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 0x7fded4151b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdec40098f0 tx=0x7fdec40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4040020 con 0x7fded4070ba0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec4038040 con 0x7fded4070ba0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded415cbe0 con 0x7fded4070ba0 2024-09-10T09:22:16.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4037070 con 0x7fded4070ba0 2024-09-10T09:22:16.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fded41f2a90 con 0x7fded4070ba0 2024-09-10T09:22:16.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdec4043020 con 0x7fded4070ba0 2024-09-10T09:22:16.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.770+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fdec4045ae0 con 0x7fded4070ba0 2024-09-10T09:22:16.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.771+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded4071920 con 0x7fded4070ba0 2024-09-10T09:22:16.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.773+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdec404a030 con 0x7fded4070ba0 2024-09-10T09:22:16.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.840+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b9c37d23-c62c-47da-8357-767f81e5740d", "id": 5} v 0) -- 0x7fded406c520 con 0x7fded4070ba0 2024-09-10T09:22:16.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.845+0000 7fded0ff9640 1 -- 172.21.15.100:0/3660586921 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9c37d23-c62c-47da-8357-767f81e5740d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fdec4032e20 con 0x7fded4070ba0 2024-09-10T09:22:16.847 INFO:teuthology.orchestra.run.smithi100.stdout:5 2024-09-10T09:22:16.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 msgr2=0x7fded4151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 0x7fded4151b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdec40098f0 tx=0x7fdec40046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 shutdown_connections 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded415c670 0x7fded40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fded40cfb00 0x7fded40b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 --2- 172.21.15.100:0/3660586921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fded4070ba0 0x7fded4151b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 >> 172.21.15.100:0/3660586921 conn(0x7fded40cf010 msgr2=0x7fded40b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 shutdown_connections 2024-09-10T09:22:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.846+0000 7fdeda35b640 1 -- 172.21.15.100:0/3660586921 wait complete. 2024-09-10T09:22:16.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new a086eced-fc1a-4d17-8a2a-62eb9afd4581 6 2024-09-10T09:22:16.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.957+0000 7fe8c77d6640 1 Processor -- start 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.957+0000 7fe8c77d6640 1 -- start start 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c77d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8c00afa20 0x7fe8c00afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c77d6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c00b4250 con 0x7fe8c00b5060 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c77d6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c00ae980 con 0x7fe8c006bba0 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c77d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c00b03a0 con 0x7fe8c00afa20 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c4d71640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8c00afa20 0x7fe8c00afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c4d71640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8c00afa20 0x7fe8c00afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53432/0 (socket says 172.21.15.100:53432) 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c5572640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe8c006bba0 0x7fe8c006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48594/0 (socket says 172.21.15.100:48594) 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c4d71640 1 -- 172.21.15.100:0/3853096395 learned_addr learned my addr 172.21.15.100:0/3853096395 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c4d71640 1 -- 172.21.15.100:0/3853096395 >> v1:172.21.15.100:6789/0 conn(0x7fe8c006bba0 legacy=0x7fe8c006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c4d71640 1 -- 172.21.15.100:0/3853096395 >> v1:172.21.15.12:6789/0 conn(0x7fe8c00b5060 legacy=0x7fe8c006e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.958+0000 7fe8c4d71640 1 -- 172.21.15.100:0/3853096395 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c00aec60 con 0x7fe8c00afa20 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8c4d71640 1 --2- 172.21.15.100:0/3853096395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00afa20 0x7fe8c00afe60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009870 tx=0x7fe8b002a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f82644f7507681b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8b7fff640 1 -- 172.21.15.100:0/3853096395 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0037070 con 0x7fe8c00afa20 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8b7fff640 1 -- 172.21.15.100:0/3853096395 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b0032440 con 0x7fe8c00afa20 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8b7fff640 1 -- 172.21.15.100:0/3853096395 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0032810 con 0x7fe8c00afa20 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8c77d6640 1 -- 172.21.15.100:0/3853096395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00afa20 msgr2=0x7fe8c00afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8c77d6640 1 --2- 172.21.15.100:0/3853096395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00afa20 0x7fe8c00afe60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009870 tx=0x7fe8b002a2a0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8c77d6640 1 -- 172.21.15.100:0/3853096395 shutdown_connections 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8c77d6640 1 --2- 172.21.15.100:0/3853096395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00afa20 0x7fe8c00afe60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.959+0000 7fe8c77d6640 1 -- 172.21.15.100:0/3853096395 >> 172.21.15.100:0/3853096395 conn(0x7fe8c00b3380 msgr2=0x7fe8c00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.960+0000 7fe8c77d6640 1 -- 172.21.15.100:0/3853096395 shutdown_connections 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.960+0000 7fe8c77d6640 1 -- 172.21.15.100:0/3853096395 wait complete. 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 Processor -- start 2024-09-10T09:22:16.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 -- start start 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c006bba0 0x7fe8c01f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 0x7fe8c00ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00b5060 0x7fe8c00c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01483e0 con 0x7fe8c006bba0 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00af220 con 0x7fe8c00b5060 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.961+0000 7fe8c77d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c006ee20 con 0x7fe8c00afa20 2024-09-10T09:22:16.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 0x7fe8c00ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c5d73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00b5060 0x7fe8c00c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 0x7fe8c00ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:45132/0 (socket says 172.21.15.100:45132) 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 -- 172.21.15.100:0/1837021503 learned_addr learned my addr 172.21.15.100:0/1837021503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c5572640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c006bba0 0x7fe8c01f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 -- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00b5060 msgr2=0x7fe8c00c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00b5060 0x7fe8c00c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 -- 172.21.15.100:0/1837021503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c006bba0 msgr2=0x7fe8c01f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c006bba0 0x7fe8c01f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 -- 172.21.15.100:0/1837021503 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c00c8350 con 0x7fe8c00afa20 2024-09-10T09:22:16.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c5572640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c006bba0 0x7fe8c01f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c5d73640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00b5060 0x7fe8c00c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c4d71640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 0x7fe8c00ca1d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009870 tx=0x7fe8b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0041070 con 0x7fe8c00afa20 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b003c870 con 0x7fe8c00afa20 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c00c8630 con 0x7fe8c00afa20 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0037040 con 0x7fe8c00afa20 2024-09-10T09:22:16.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.962+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c00c8bf0 con 0x7fe8c00afa20 2024-09-10T09:22:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.963+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe8b0044070 con 0x7fe8c00afa20 2024-09-10T09:22:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.963+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe8b0046b30 con 0x7fe8c00afa20 2024-09-10T09:22:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.963+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c00afe60 con 0x7fe8c00afa20 2024-09-10T09:22:16.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:16.965+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe8b003cc60 con 0x7fe8c00afa20 2024-09-10T09:22:17.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.034+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a086eced-fc1a-4d17-8a2a-62eb9afd4581", "id": 6} v 0) -- 0x7fe8c006c390 con 0x7fe8c00afa20 2024-09-10T09:22:17.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.039+0000 7fe8b5ffb640 1 -- 172.21.15.100:0/1837021503 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a086eced-fc1a-4d17-8a2a-62eb9afd4581", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe8b0046450 con 0x7fe8c00afa20 2024-09-10T09:22:17.039 INFO:teuthology.orchestra.run.smithi100.stdout:6 2024-09-10T09:22:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 msgr2=0x7fe8c00ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 0x7fe8c00ca1d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009870 tx=0x7fe8b00046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 shutdown_connections 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c00b5060 0x7fe8c00c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8c00afa20 0x7fe8c00ca1d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 --2- 172.21.15.100:0/1837021503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c006bba0 0x7fe8c01f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 >> 172.21.15.100:0/1837021503 conn(0x7fe8c00b3380 msgr2=0x7fe8c006f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 shutdown_connections 2024-09-10T09:22:17.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.040+0000 7fe8c77d6640 1 -- 172.21.15.100:0/1837021503 wait complete. 2024-09-10T09:22:17.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new f8ed8da4-343f-4733-86fd-ec505d12ad08 7 2024-09-10T09:22:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.149+0000 7fc6cebc4640 1 Processor -- start 2024-09-10T09:22:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.149+0000 7fc6cebc4640 1 -- start start 2024-09-10T09:22:17.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cebc4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6c8155bb0 0x7fc6c815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cebc4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6c815c190 0x7fc6c8070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cebc4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c815c7b0 con 0x7fc6c806fda0 2024-09-10T09:22:17.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cebc4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c8070740 con 0x7fc6c8155bb0 2024-09-10T09:22:17.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cebc4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c80cf770 con 0x7fc6c815c190 2024-09-10T09:22:17.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cd161640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6c815c190 0x7fc6c8070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cd161640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6c815c190 0x7fc6c8070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53442/0 (socket says 172.21.15.100:53442) 2024-09-10T09:22:17.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cd161640 1 -- 172.21.15.100:0/2326808277 learned_addr learned my addr 172.21.15.100:0/2326808277 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:17.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.150+0000 7fc6cc960640 1 --2- 172.21.15.100:0/2326808277 >> v2:172.21.15.12:3300/0 conn(0x7fc6c8155bb0 0x7fc6c815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6cd161640 1 -- 172.21.15.100:0/2326808277 >> v2:172.21.15.12:3300/0 conn(0x7fc6c8155bb0 msgr2=0x7fc6c815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:17.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6cd161640 1 --2- 172.21.15.100:0/2326808277 >> v2:172.21.15.12:3300/0 conn(0x7fc6c8155bb0 0x7fc6c815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6cd161640 1 -- 172.21.15.100:0/2326808277 >> v1:172.21.15.12:6789/0 conn(0x7fc6c806fda0 legacy=0x7fc6c815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6cd161640 1 -- 172.21.15.100:0/2326808277 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c80cfa50 con 0x7fc6c815c190 2024-09-10T09:22:17.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6cd161640 1 --2- 172.21.15.100:0/2326808277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c815c190 0x7fc6c8070200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8069f40 tx=0x7fc6c002c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac8fee61889ff42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:17.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6c77fe640 1 -- 172.21.15.100:0/2326808277 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b2e0 con 0x7fc6c815c190 2024-09-10T09:22:17.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6c77fe640 1 -- 172.21.15.100:0/2326808277 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c0037070 con 0x7fc6c815c190 2024-09-10T09:22:17.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.151+0000 7fc6c77fe640 1 -- 172.21.15.100:0/2326808277 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b480 con 0x7fc6c815c190 2024-09-10T09:22:17.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2326808277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c815c190 msgr2=0x7fc6c8070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2326808277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c815c190 0x7fc6c8070200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8069f40 tx=0x7fc6c002c940 comp rx=0 tx=0).stop 2024-09-10T09:22:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2326808277 shutdown_connections 2024-09-10T09:22:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2326808277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c815c190 0x7fc6c8070200 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2326808277 >> v2:172.21.15.12:3300/0 conn(0x7fc6c8155bb0 0x7fc6c815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2326808277 >> 172.21.15.100:0/2326808277 conn(0x7fc6c80b3380 msgr2=0x7fc6c80b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2326808277 shutdown_connections 2024-09-10T09:22:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.152+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2326808277 wait complete. 2024-09-10T09:22:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.153+0000 7fc6cebc4640 1 Processor -- start 2024-09-10T09:22:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.153+0000 7fc6cebc4640 1 -- start start 2024-09-10T09:22:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cebc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 0x7fc6c814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cebc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6c8155bb0 0x7fc6c80b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cebc4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6c815c190 0x7fc6c814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cebc4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c815e030 con 0x7fc6c8155bb0 2024-09-10T09:22:17.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cebc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c80cf480 con 0x7fc6c806fda0 2024-09-10T09:22:17.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cebc4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c815e1b0 con 0x7fc6c815c190 2024-09-10T09:22:17.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cc960640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 0x7fc6c814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cc960640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 0x7fc6c814c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53458/0 (socket says 172.21.15.100:53458) 2024-09-10T09:22:17.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cc960640 1 -- 172.21.15.100:0/2781041127 learned_addr learned my addr 172.21.15.100:0/2781041127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T09:22:17.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6cd161640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6c815c190 0x7fc6c814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.154+0000 7fc6c7fff640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6c8155bb0 0x7fc6c80b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cc960640 1 -- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6c815c190 msgr2=0x7fc6c814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cc960640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6c815c190 0x7fc6c814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cc960640 1 -- 172.21.15.100:0/2781041127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6c8155bb0 msgr2=0x7fc6c80b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cc960640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6c8155bb0 0x7fc6c80b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cc960640 1 -- 172.21.15.100:0/2781041127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c814cc10 con 0x7fc6c806fda0 2024-09-10T09:22:17.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cc960640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 0x7fc6c814c6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e9b0 tx=0x7fc6bc00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:17.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc017070 con 0x7fc6c806fda0 2024-09-10T09:22:17.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00c9a0 con 0x7fc6c806fda0 2024-09-10T09:22:17.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00cd90 con 0x7fc6c806fda0 2024-09-10T09:22:17.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c80b1780 con 0x7fc6c806fda0 2024-09-10T09:22:17.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c80b1d40 con 0x7fc6c806fda0 2024-09-10T09:22:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc6bc01a070 con 0x7fc6c806fda0 2024-09-10T09:22:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.155+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc6bc006660 con 0x7fc6c806fda0 2024-09-10T09:22:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.156+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c8070200 con 0x7fc6c806fda0 2024-09-10T09:22:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.158+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc6bc005990 con 0x7fc6c806fda0 2024-09-10T09:22:17.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.226+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8ed8da4-343f-4733-86fd-ec505d12ad08", "id": 7} v 0) -- 0x7fc6c815f240 con 0x7fc6c806fda0 2024-09-10T09:22:17.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.234+0000 7fc6c57fa640 1 -- 172.21.15.100:0/2781041127 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8ed8da4-343f-4733-86fd-ec505d12ad08", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc6bc005b70 con 0x7fc6c806fda0 2024-09-10T09:22:17.235 INFO:teuthology.orchestra.run.smithi100.stdout:7 2024-09-10T09:22:17.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 msgr2=0x7fc6c814c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 0x7fc6c814c6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e9b0 tx=0x7fc6bc00ee70 comp rx=0 tx=0).stop 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 shutdown_connections 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6c815c190 0x7fc6c814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6c8155bb0 0x7fc6c80b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 --2- 172.21.15.100:0/2781041127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6c806fda0 0x7fc6c814c6d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 >> 172.21.15.100:0/2781041127 conn(0x7fc6c80b3380 msgr2=0x7fc6c815f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 shutdown_connections 2024-09-10T09:22:17.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:17.235+0000 7fc6cebc4640 1 -- 172.21.15.100:0/2781041127 wait complete. 2024-09-10T09:22:17.245 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T09:22:17.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T09:22:17.248 INFO:tasks.ceph.osd.0:Started 2024-09-10T09:22:17.249 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T09:22:17.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T09:22:17.251 INFO:tasks.ceph.osd.1:Started 2024-09-10T09:22:17.251 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T09:22:17.252 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T09:22:17.254 INFO:tasks.ceph.osd.2:Started 2024-09-10T09:22:17.254 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T09:22:17.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T09:22:17.256 INFO:tasks.ceph.osd.3:Started 2024-09-10T09:22:17.256 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T09:22:17.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T09:22:17.259 INFO:tasks.ceph.osd.4:Started 2024-09-10T09:22:17.259 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T09:22:17.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T09:22:17.261 INFO:tasks.ceph.osd.5:Started 2024-09-10T09:22:17.261 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T09:22:17.261 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T09:22:17.263 INFO:tasks.ceph.osd.6:Started 2024-09-10T09:22:17.263 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T09:22:17.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T09:22:17.265 INFO:tasks.ceph.osd.7:Started 2024-09-10T09:22:17.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:17.285 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:17.285+0000 7ff174d33040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T09:22:17.356 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:17.356+0000 7ff174d33040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T09:22:17.360 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:17.359+0000 7f91841dd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T09:22:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.393+0000 7f525d00e640 1 Processor -- start 2024-09-10T09:22:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.393+0000 7f525d00e640 1 -- start start 2024-09-10T09:22:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f525d00e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f525815c690 0x7f52580b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f525d00e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5258073da0 con 0x7f52580b4290 2024-09-10T09:22:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f525d00e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5258074060 con 0x7f52580b1980 2024-09-10T09:22:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f525d00e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f52580b6aa0 con 0x7f525815c690 2024-09-10T09:22:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f525759e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52580b4290 0x7f52580b6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48992/0 (socket says 172.21.15.12:48992) 2024-09-10T09:22:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f5256d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f525815c690 0x7f52580b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f525759e640 1 -- 172.21.15.12:0/2551989387 learned_addr learned my addr 172.21.15.12:0/2551989387 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f5256d9d640 1 -- 172.21.15.12:0/2551989387 >> v1:172.21.15.100:6789/0 conn(0x7f52580b1980 legacy=0x7f52580d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f5256d9d640 1 -- 172.21.15.12:0/2551989387 >> v1:172.21.15.12:6789/0 conn(0x7f52580b4290 legacy=0x7f52580b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.394+0000 7f5256d9d640 1 -- 172.21.15.12:0/2551989387 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52580733a0 con 0x7f525815c690 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.395+0000 7f5255d9b640 1 -- 172.21.15.12:0/2551989387 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307563191 0 0) 0x7f5258074060 con 0x7f52580b1980 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.395+0000 7f5256d9d640 1 --2- 172.21.15.12:0/2551989387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f525815c690 0x7f52580b6010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f52480097a0 tx=0x7f524802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa30c5cc2769ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.395+0000 7f5255d9b640 1 -- 172.21.15.12:0/2551989387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248037070 con 0x7f525815c690 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.395+0000 7f5255d9b640 1 -- 172.21.15.12:0/2551989387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524802adc0 con 0x7f525815c690 2024-09-10T09:22:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.395+0000 7f5255d9b640 1 -- 172.21.15.12:0/2551989387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248032660 con 0x7f525815c690 2024-09-10T09:22:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 -- 172.21.15.12:0/2551989387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f525815c690 msgr2=0x7f52580b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 --2- 172.21.15.12:0/2551989387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f525815c690 0x7f52580b6010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f52480097a0 tx=0x7f524802a130 comp rx=0 tx=0).stop 2024-09-10T09:22:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 -- 172.21.15.12:0/2551989387 shutdown_connections 2024-09-10T09:22:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 --2- 172.21.15.12:0/2551989387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f525815c690 0x7f52580b6010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 -- 172.21.15.12:0/2551989387 >> 172.21.15.12:0/2551989387 conn(0x7f5258062630 msgr2=0x7f5258062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:17.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 -- 172.21.15.12:0/2551989387 shutdown_connections 2024-09-10T09:22:17.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.396+0000 7f525d00e640 1 -- 172.21.15.12:0/2551989387 wait complete. 2024-09-10T09:22:17.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.397+0000 7f525d00e640 1 Processor -- start 2024-09-10T09:22:17.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.397+0000 7f525d00e640 1 -- start start 2024-09-10T09:22:17.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525d00e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52580b1980 0x7f52581480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525d00e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 0x7f525815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 0x7f525815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 0x7f525815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33644/0 (socket says 172.21.15.12:33644) 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525659c640 1 -- 172.21.15.12:0/3679075616 learned_addr learned my addr 172.21.15.12:0/3679075616 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f5256d9d640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52580b1980 0x7f52581480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525d00e640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525815c690 0x7f525815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f52580d0dd0 con 0x7f52580b4290 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52580d0c50 con 0x7f525815c690 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.398+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f52580b76d0 con 0x7f52580b1980 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525759e640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525815c690 0x7f525815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525659c640 1 -- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52580b1980 msgr2=0x7f52581480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525659c640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52580b1980 0x7f52581480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525659c640 1 -- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525815c690 msgr2=0x7f525815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525659c640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525815c690 0x7f525815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525659c640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525815e750 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525659c640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 0x7f525815aaf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f524000c6d0 tx=0x7f524000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240005070 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5240005210 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525815ea30 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524000a640 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f524000a8a0 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.399+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525815eff0 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.400+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f524001b400 con 0x7f52580b4290 2024-09-10T09:22:17.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.401+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52580b6010 con 0x7f52580b4290 2024-09-10T09:22:17.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.403+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f524000adc0 con 0x7f52580b4290 2024-09-10T09:22:17.420 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:17.418+0000 7f91841dd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T09:22:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.463+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f525815f480 con 0x7f52580b4290 2024-09-10T09:22:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.464+0000 7f524f7fe640 1 -- 172.21.15.12:0/3679075616 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f52400035f0 con 0x7f52580b4290 2024-09-10T09:22:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:17.227643+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 msgr2=0x7f525815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 0x7f525815aaf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f524000c6d0 tx=0x7f524000cb90 comp rx=0 tx=0).stop 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 shutdown_connections 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525815c690 0x7f525815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52580b4290 0x7f525815aaf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 --2- 172.21.15.12:0/3679075616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52580b1980 0x7f52581480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 >> 172.21.15.12:0/3679075616 conn(0x7f5258062630 msgr2=0x7f52580b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 shutdown_connections 2024-09-10T09:22:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:17.465+0000 7f525d00e640 1 -- 172.21.15.12:0/3679075616 wait complete. 2024-09-10T09:22:17.478 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T09:22:17.478 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T09:22:17.725 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:17.724+0000 7ff174d33040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T09:22:17.808 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:17.808+0000 7ff174d33040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T09:22:17.810 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:17.808+0000 7f91841dd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T09:22:17.899 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:17.898+0000 7f91841dd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T09:22:17.916 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:17.915+0000 7ff174d33040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T09:22:17.963 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:17.963+0000 7ff174d33040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T09:22:18.012 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.010+0000 7f91841dd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T09:22:18.061 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.059+0000 7f91841dd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T09:22:18.076 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.076+0000 7ff174d33040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T09:22:18.130 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.129+0000 7ff174d33040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T09:22:18.175 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.175+0000 7ff174d33040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T09:22:18.181 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.179+0000 7f91841dd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T09:22:18.237 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.236+0000 7f91841dd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T09:22:18.283 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:18.285 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.283+0000 7f91841dd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T09:22:18.290 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.289+0000 7ff174d33040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T09:22:18.340 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.339+0000 7ff174d33040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T09:22:18.377 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.375+0000 7f837949b640 1 Processor -- start 2024-09-10T09:22:18.377 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.375+0000 7f837949b640 1 -- start start 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f837949b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f837415e7b0 0x7f83740b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f837949b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83740b6710 0x7f83740d3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f837949b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83740678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f837949b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f83740b7f40 con 0x7f837415e7b0 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f837949b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f83740b6b30 con 0x7f83740b6710 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f837949b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f837415eb90 con 0x7f83740d39b0 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f837415e7b0 0x7f83740b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f837415e7b0 0x7f83740b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33650/0 (socket says 172.21.15.12:33650) 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 -- 172.21.15.12:0/2138298347 learned_addr learned my addr 172.21.15.12:0/2138298347 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f836bfff640 1 --2- 172.21.15.12:0/2138298347 >> v2:172.21.15.100:3300/0 conn(0x7f83740b6710 0x7f83740d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:18.379 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f83737fe640 1 --2- 172.21.15.12:0/2138298347 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83740678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 -- 172.21.15.12:0/2138298347 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 msgr2=0x7f83740678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 --2- 172.21.15.12:0/2138298347 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83740678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 -- 172.21.15.12:0/2138298347 >> v2:172.21.15.100:3300/0 conn(0x7f83740b6710 msgr2=0x7f83740d3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 --2- 172.21.15.12:0/2138298347 >> v2:172.21.15.100:3300/0 conn(0x7f83740b6710 0x7f83740d3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.376+0000 7f8372ffd640 1 -- 172.21.15.12:0/2138298347 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83740d4230 con 0x7f837415e7b0 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.377+0000 7f8372ffd640 1 --2- 172.21.15.12:0/2138298347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740b61d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f837408dc30 tx=0x7f836402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fc479afb94637b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.377+0000 7f83727fc640 1 -- 172.21.15.12:0/2138298347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364037070 con 0x7f837415e7b0 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.377+0000 7f83727fc640 1 -- 172.21.15.12:0/2138298347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364032440 con 0x7f837415e7b0 2024-09-10T09:22:18.380 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.377+0000 7f83727fc640 1 -- 172.21.15.12:0/2138298347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364032810 con 0x7f837415e7b0 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 -- 172.21.15.12:0/2138298347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 msgr2=0x7f83740b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 --2- 172.21.15.12:0/2138298347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740b61d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f837408dc30 tx=0x7f836402a1e0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 -- 172.21.15.12:0/2138298347 shutdown_connections 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 --2- 172.21.15.12:0/2138298347 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83740678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 --2- 172.21.15.12:0/2138298347 >> v2:172.21.15.100:3300/0 conn(0x7f83740b6710 0x7f83740d3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 --2- 172.21.15.12:0/2138298347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740b61d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 -- 172.21.15.12:0/2138298347 >> 172.21.15.12:0/2138298347 conn(0x7f8374072860 msgr2=0x7f83740d4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 -- 172.21.15.12:0/2138298347 shutdown_connections 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.378+0000 7f837949b640 1 -- 172.21.15.12:0/2138298347 wait complete. 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.379+0000 7f837949b640 1 Processor -- start 2024-09-10T09:22:18.383 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.379+0000 7f837949b640 1 -- start start 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f837949b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83740b6710 0x7f8374158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f837949b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83741577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f837949b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f837949b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f83740b7bd0 con 0x7f837415e7b0 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f837949b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83740b78f0 con 0x7f83740b6710 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f837949b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f83740d3e00 con 0x7f83740d39b0 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:18.384 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f836bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83741577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33652/0 (socket says 172.21.15.12:33652) 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 -- 172.21.15.12:0/1981765165 learned_addr learned my addr 172.21.15.12:0/1981765165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f8372ffd640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83740b6710 0x7f8374158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 -- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 msgr2=0x7f83741577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83741577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 -- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83740b6710 msgr2=0x7f8374158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.380+0000 7f83737fe640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83740b6710 0x7f8374158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f83737fe640 1 -- 172.21.15.12:0/1981765165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8374158ba0 con 0x7f837415e7b0 2024-09-10T09:22:18.385 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f836bfff640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83741577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f83737fe640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740c9fa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f836c00efc0 tx=0x7f836c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c018020 con 0x7f837415e7b0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836c014480 con 0x7f837415e7b0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83741f4640 con 0x7f837415e7b0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c014870 con 0x7f837415e7b0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83741f4c00 con 0x7f837415e7b0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f836c005d10 con 0x7f837415e7b0 2024-09-10T09:22:18.386 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.381+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f836c013ab0 con 0x7f837415e7b0 2024-09-10T09:22:18.387 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.382+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83740d3470 con 0x7f837415e7b0 2024-09-10T09:22:18.387 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.384+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f836c022070 con 0x7f837415e7b0 2024-09-10T09:22:18.391 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.390+0000 7ff174d33040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T09:22:18.406 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.405+0000 7f91841dd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T09:22:18.446 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.444+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83741f7890 con 0x7f837415e7b0 2024-09-10T09:22:18.446 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.445+0000 7f836b7fe640 1 -- 172.21.15.12:0/1981765165 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f836c010040 con 0x7f837415e7b0 2024-09-10T09:22:18.446 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-10T09:22:18.447 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:17.227643+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:18.447 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 msgr2=0x7f83740c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740c9fa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f836c00efc0 tx=0x7f836c00c490 comp rx=0 tx=0).stop 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 shutdown_connections 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f837415e7b0 0x7f83740c9fa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f83740d39b0 0x7f83741577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 --2- 172.21.15.12:0/1981765165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83740b6710 0x7f8374158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 >> 172.21.15.12:0/1981765165 conn(0x7f8374072860 msgr2=0x7f83740d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 shutdown_connections 2024-09-10T09:22:18.448 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:18.446+0000 7f837949b640 1 -- 172.21.15.12:0/1981765165 wait complete. 2024-09-10T09:22:18.456 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T09:22:18.459 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.458+0000 7ff174d33040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T09:22:18.460 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.459+0000 7f91841dd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T09:22:18.505 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.504+0000 7ff174d33040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T09:22:18.517 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.513+0000 7f91841dd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T09:22:18.550 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:18.549+0000 7ff174d33040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T09:22:18.586 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.584+0000 7f91841dd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T09:22:18.632 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.631+0000 7f91841dd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T09:22:18.679 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:18.677+0000 7f91841dd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T09:22:18.745 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-10T09:22:18.744+0000 7f209f1dd640 -1 Falling back to public interface 2024-09-10T09:22:18.759 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-09-10T09:22:18.759+0000 7fd3e77a4640 -1 Falling back to public interface 2024-09-10T09:22:18.768 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-09-10T09:22:18.768+0000 7f4389c20640 -1 Falling back to public interface 2024-09-10T09:22:18.959 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-10T09:22:18.957+0000 7faae6683640 -1 Falling back to public interface 2024-09-10T09:22:18.964 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-09-10T09:22:18.964+0000 7f3dc5ced640 -1 Falling back to public interface 2024-09-10T09:22:18.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-10T09:22:18.975+0000 7f3f12218640 -1 Falling back to public interface 2024-09-10T09:22:18.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-10T09:22:18.975+0000 7fda9a483640 -1 Falling back to public interface 2024-09-10T09:22:18.980 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-10T09:22:18.979+0000 7f36ae94b640 -1 Falling back to public interface 2024-09-10T09:22:19.206 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:19.206+0000 7ff174d33040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T09:22:19.378 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-09-10T09:22:19.377+0000 7f91841dd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T09:22:20.223 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:20.223+0000 7ff114bb5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T09:22:20.224 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:22:20.224+0000 7ff114bb5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T09:22:22.759 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-10T09:22:22.759+0000 7f209f1dd640 -1 osd.6 0 log_to_monitors true 2024-09-10T09:22:22.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-10T09:22:22.789+0000 7f3f12218640 -1 osd.0 0 log_to_monitors true 2024-09-10T09:22:22.839 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-09-10T09:22:22.839+0000 7fd3e77a4640 -1 osd.5 0 log_to_monitors true 2024-09-10T09:22:22.988 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-09-10T09:22:22.988+0000 7f3dc5ced640 -1 osd.7 0 log_to_monitors true 2024-09-10T09:22:23.202 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-10T09:22:23.201+0000 7faae6683640 -1 osd.2 0 log_to_monitors true 2024-09-10T09:22:23.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-10T09:22:23.277+0000 7fda9a483640 -1 osd.1 0 log_to_monitors true 2024-09-10T09:22:23.319 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-10T09:22:23.317+0000 7f36ae94b640 -1 osd.3 0 log_to_monitors true 2024-09-10T09:22:23.332 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-09-10T09:22:23.331+0000 7f4389c20640 -1 osd.4 0 log_to_monitors true 2024-09-10T09:22:25.264 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:25.388 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.386+0000 7f4c77d9a640 1 Processor -- start 2024-09-10T09:22:25.389 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.387+0000 7f4c77d9a640 1 -- start start 2024-09-10T09:22:25.390 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c77d9a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c7015c710 0x7f4c7015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:25.390 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c77d9a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c700b6680 0x7f4c700b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c77d9a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7015db00 con 0x7f4c700b3220 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c77d9a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4c700b6e80 con 0x7f4c7015c710 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c77d9a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4c70160000 con 0x7f4c700b6680 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c75335640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4c700b3220 0x7f4c700b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:45212/0 (socket says 172.21.15.12:45212) 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c75335640 1 -- 172.21.15.12:0/1809970629 learned_addr learned my addr 172.21.15.12:0/1809970629 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c76337640 1 --2- 172.21.15.12:0/1809970629 >> v2:172.21.15.100:3300/0 conn(0x7f4c700b6680 0x7f4c700b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.388+0000 7f4c75b36640 1 --2- 172.21.15.12:0/1809970629 >> v2:172.21.15.12:3300/0 conn(0x7f4c7015c710 0x7f4c7015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.389+0000 7f4c76337640 1 -- 172.21.15.12:0/1809970629 >> v2:172.21.15.12:3300/0 conn(0x7f4c7015c710 msgr2=0x7f4c7015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.389+0000 7f4c76337640 1 --2- 172.21.15.12:0/1809970629 >> v2:172.21.15.12:3300/0 conn(0x7f4c7015c710 0x7f4c7015fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.389+0000 7f4c76337640 1 -- 172.21.15.12:0/1809970629 >> v1:172.21.15.100:6789/0 conn(0x7f4c700b3220 legacy=0x7f4c700b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.389+0000 7f4c76337640 1 -- 172.21.15.12:0/1809970629 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7015e740 con 0x7f4c700b6680 2024-09-10T09:22:25.391 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.389+0000 7f4c75b36640 1 --2- 172.21.15.12:0/1809970629 >> v2:172.21.15.12:3300/0 conn(0x7f4c7015c710 0x7f4c7015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:25.392 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.390+0000 7f4c76337640 1 --2- 172.21.15.12:0/1809970629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c700b3670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c700687c0 tx=0x7f4c6802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=757419a45cb057c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:25.409 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.408+0000 7f4c74b34640 1 -- 172.21.15.12:0/1809970629 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68007740 con 0x7f4c700b6680 2024-09-10T09:22:25.409 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.408+0000 7f4c74b34640 1 -- 172.21.15.12:0/1809970629 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c680078e0 con 0x7f4c700b6680 2024-09-10T09:22:25.410 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.408+0000 7f4c74b34640 1 -- 172.21.15.12:0/1809970629 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68007cb0 con 0x7f4c700b6680 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1809970629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 msgr2=0x7f4c700b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 --2- 172.21.15.12:0/1809970629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c700b3670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c700687c0 tx=0x7f4c6802a680 comp rx=0 tx=0).stop 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1809970629 shutdown_connections 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 --2- 172.21.15.12:0/1809970629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c700b3670 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 --2- 172.21.15.12:0/1809970629 >> v2:172.21.15.12:3300/0 conn(0x7f4c7015c710 0x7f4c7015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1809970629 >> 172.21.15.12:0/1809970629 conn(0x7f4c700737f0 msgr2=0x7f4c7009ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1809970629 shutdown_connections 2024-09-10T09:22:25.411 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.409+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1809970629 wait complete. 2024-09-10T09:22:25.413 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.411+0000 7f4c77d9a640 1 Processor -- start 2024-09-10T09:22:25.413 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.411+0000 7f4c77d9a640 1 -- start start 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.412+0000 7f4c77d9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c700b3220 0x7f4c700afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.412+0000 7f4c77d9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c7009ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.412+0000 7f4c77d9a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7015c710 0x7f4c7009db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.412+0000 7f4c77d9a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7015efe0 con 0x7f4c700b3220 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.412+0000 7f4c77d9a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7015ed00 con 0x7f4c700b6680 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.412+0000 7f4c77d9a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7015f2c0 con 0x7f4c7015c710 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c75335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c7009ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:25.416 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c75335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c7009ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:38022/0 (socket says 172.21.15.12:38022) 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c75335640 1 -- 172.21.15.12:0/1316177348 learned_addr learned my addr 172.21.15.12:0/1316177348 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7015c710 0x7f4c7009db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c75b36640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c700b3220 0x7f4c700afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 -- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 msgr2=0x7f4c7009ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c7009ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 -- 172.21.15.12:0/1316177348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c700b3220 msgr2=0x7f4c700afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c700b3220 0x7f4c700afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 -- 172.21.15.12:0/1316177348 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700b07f0 con 0x7f4c7015c710 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c75b36640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c700b3220 0x7f4c700afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.413+0000 7f4c76337640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7015c710 0x7f4c7009db70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c700b5510 tx=0x7f4c68004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.414+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68040070 con 0x7f4c7015c710 2024-09-10T09:22:25.417 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.414+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68045460 con 0x7f4c7015c710 2024-09-10T09:22:25.418 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.414+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1316177348 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c700b0230 con 0x7f4c7015c710 2024-09-10T09:22:25.418 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.414+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68009450 con 0x7f4c7015c710 2024-09-10T09:22:25.418 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.414+0000 7f4c77d9a640 1 -- 172.21.15.12:0/1316177348 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7009f740 con 0x7f4c7015c710 2024-09-10T09:22:25.419 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.416+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c005290 con 0x7f4c7015c710 2024-09-10T09:22:25.419 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.417+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f4c68039040 con 0x7f4c7015c710 2024-09-10T09:22:25.419 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.418+0000 7f4c667fc640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4c5406bda0 0x7f4c5406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:25.420 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.418+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f4c680ab7a0 con 0x7f4c7015c710 2024-09-10T09:22:25.420 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.418+0000 7f4c75b36640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4c5406bda0 0x7f4c5406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:25.420 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.418+0000 7f4c75b36640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4c5406bda0 0x7f4c5406e260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c006fd0 tx=0x7f4c6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:25.424 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.423+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c6807b000 con 0x7f4c7015c710 2024-09-10T09:22:25.674 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.673+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c4c005580 con 0x7f4c7015c710 2024-09-10T09:22:25.675 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.674+0000 7f4c667fc640 1 -- 172.21.15.12:0/1316177348 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f4c6807f300 con 0x7f4c7015c710 2024-09-10T09:22:25.676 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-10T09:22:25.676 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":13,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:25.234565+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4c5406bda0 msgr2=0x7f4c5406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4c5406bda0 0x7f4c5406e260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c006fd0 tx=0x7f4c6c008040 comp rx=0 tx=0).stop 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7015c710 msgr2=0x7f4c7009db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7015c710 0x7f4c7009db70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c700b5510 tx=0x7f4c68004a40 comp rx=0 tx=0).stop 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 shutdown_connections 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4c5406bda0 0x7f4c5406e260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7015c710 0x7f4c7009db70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.680 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c700b6680 0x7f4c7009ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.681 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 --2- 172.21.15.12:0/1316177348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c700b3220 0x7f4c700afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:25.681 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 >> 172.21.15.12:0/1316177348 conn(0x7f4c700737f0 msgr2=0x7f4c7015b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:25.681 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 shutdown_connections 2024-09-10T09:22:25.681 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:25.678+0000 7f4c53fff640 1 -- 172.21.15.12:0/1316177348 wait complete. 2024-09-10T09:22:25.695 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T09:22:25.723 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-10T09:22:25.721+0000 7faae1def640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T09:22:25.753 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-10T09:22:25.752+0000 7faada421640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:25.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-10T09:22:25.768+0000 7f3f0e2b3640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T09:22:25.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-10T09:22:25.923+0000 7f3f058ae640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:26.080 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-10T09:22:26.079+0000 7f209a949640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T09:22:26.093 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-10T09:22:26.092+0000 7f2092f7b640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:26.148 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-09-10T09:22:26.147+0000 7f3dc1459640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T09:22:26.158 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-09-10T09:22:26.157+0000 7f3db9a8b640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:26.164 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-09-10T09:22:26.163+0000 7fd3e2f10640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T09:22:26.174 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-09-10T09:22:26.173+0000 7fd3db542640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:26.359 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-09-10T09:22:26.358+0000 7f43863c3640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T09:22:26.372 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-09-10T09:22:26.371+0000 7f437d9be640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:26.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-10T09:22:26.564+0000 7fda95bef640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T09:22:26.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-10T09:22:26.575+0000 7fda8e221640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:26.579 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-10T09:22:26.578+0000 7f36aa0b7640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T09:22:26.594 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-09-10T09:22:26.593+0000 7f36a26e9640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:22:32.502 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:32.608 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.606+0000 7f65e2453640 1 Processor -- start 2024-09-10T09:22:32.608 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.606+0000 7f65e2453640 1 -- start start 2024-09-10T09:22:32.609 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65e2453640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65dc15e760 0x7f65dc0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.609 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65e2453640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f65dc0b6ea0 0x7f65dc06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.609 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65e2453640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc0b76b0 con 0x7f65dc06cb60 2024-09-10T09:22:32.609 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65e2453640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f65dc06cfd0 con 0x7f65dc15e760 2024-09-10T09:22:32.609 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65e2453640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f65dc06d370 con 0x7f65dc0b6ea0 2024-09-10T09:22:32.609 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65dbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65dc15e760 0x7f65dc0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65dbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65dc15e760 0x7f65dc0b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36746/0 (socket says 172.21.15.12:36746) 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65dbfff640 1 -- 172.21.15.12:0/2413623356 learned_addr learned my addr 172.21.15.12:0/2413623356 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.607+0000 7f65db7fe640 1 --2- 172.21.15.12:0/2413623356 >> v2:172.21.15.100:3300/0 conn(0x7f65dc0b6ea0 0x7f65dc06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.608+0000 7f65dbfff640 1 -- 172.21.15.12:0/2413623356 >> v2:172.21.15.100:3300/0 conn(0x7f65dc0b6ea0 msgr2=0x7f65dc06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.608+0000 7f65dbfff640 1 --2- 172.21.15.12:0/2413623356 >> v2:172.21.15.100:3300/0 conn(0x7f65dc0b6ea0 0x7f65dc06c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.608+0000 7f65dbfff640 1 -- 172.21.15.12:0/2413623356 >> v1:172.21.15.100:6789/0 conn(0x7f65dc06cb60 legacy=0x7f65dc162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:32.610 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.608+0000 7f65dbfff640 1 -- 172.21.15.12:0/2413623356 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc0cbae0 con 0x7f65dc15e760 2024-09-10T09:22:32.611 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.608+0000 7f65dbfff640 1 --2- 172.21.15.12:0/2413623356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc0b5eb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65dc1622c0 tx=0x7f65cc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3f8da21bda7ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:32.611 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.608+0000 7f65daffd640 1 -- 172.21.15.12:0/2413623356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc037070 con 0x7f65dc15e760 2024-09-10T09:22:32.611 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65daffd640 1 -- 172.21.15.12:0/2413623356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc032440 con 0x7f65dc15e760 2024-09-10T09:22:32.611 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65daffd640 1 -- 172.21.15.12:0/2413623356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc032810 con 0x7f65dc15e760 2024-09-10T09:22:32.611 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 -- 172.21.15.12:0/2413623356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 msgr2=0x7f65dc0b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.611 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 --2- 172.21.15.12:0/2413623356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc0b5eb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65dc1622c0 tx=0x7f65cc02a230 comp rx=0 tx=0).stop 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 -- 172.21.15.12:0/2413623356 shutdown_connections 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 --2- 172.21.15.12:0/2413623356 >> v2:172.21.15.100:3300/0 conn(0x7f65dc0b6ea0 0x7f65dc06c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 --2- 172.21.15.12:0/2413623356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc0b5eb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 -- 172.21.15.12:0/2413623356 >> 172.21.15.12:0/2413623356 conn(0x7f65dc0b7a30 msgr2=0x7f65dc0b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 -- 172.21.15.12:0/2413623356 shutdown_connections 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.609+0000 7f65e2453640 1 -- 172.21.15.12:0/2413623356 wait complete. 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.611+0000 7f65e2453640 1 Processor -- start 2024-09-10T09:22:32.612 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.611+0000 7f65e2453640 1 -- start start 2024-09-10T09:22:32.614 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65dc06cb60 0x7f65dc0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.614 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65dc0b6ea0 0x7f65dc15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc09ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc0cc130 con 0x7f65dc15e760 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc0cb890 con 0x7f65dc06cb60 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f65dc15eb40 con 0x7f65dc0b6ea0 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc09ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc09ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36750/0 (socket says 172.21.15.12:36750) 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 -- 172.21.15.12:0/2793922221 learned_addr learned my addr 172.21.15.12:0/2793922221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65dbfff640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65dc06cb60 0x7f65dc0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65db7fe640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65dc0b6ea0 0x7f65dc15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 -- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65dc0b6ea0 msgr2=0x7f65dc15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65dc0b6ea0 0x7f65dc15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 -- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65dc06cb60 msgr2=0x7f65dc0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65dc06cb60 0x7f65dc0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.615 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 -- 172.21.15.12:0/2793922221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc159570 con 0x7f65dc15e760 2024-09-10T09:22:32.616 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e09f0640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc09ebe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f65d400b9a0 tx=0x7f65d400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:32.616 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4019070 con 0x7f65dc15e760 2024-09-10T09:22:32.616 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d400cba0 con 0x7f65dc15e760 2024-09-10T09:22:32.616 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc15aed0 con 0x7f65dc15e760 2024-09-10T09:22:32.616 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.612+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4014440 con 0x7f65dc15e760 2024-09-10T09:22:32.616 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.613+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc15b490 con 0x7f65dc15e760 2024-09-10T09:22:32.617 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.614+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65dc0b73a0 con 0x7f65dc15e760 2024-09-10T09:22:32.617 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.614+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65d401c070 con 0x7f65dc15e760 2024-09-10T09:22:32.617 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.614+0000 7f65d8ff9640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65c806be30 0x7f65c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.617 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.615+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f65d408a630 con 0x7f65dc15e760 2024-09-10T09:22:32.617 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.615+0000 7f65dbfff640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65c806be30 0x7f65c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.618 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.615+0000 7f65dbfff640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65c806be30 0x7f65c806e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65cc034000 tx=0x7f65cc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:32.621 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.619+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65dc159570 con 0x7f65dc15e760 2024-09-10T09:22:32.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.800+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65dc06bf40 con 0x7f65dc15e760 2024-09-10T09:22:32.802 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.801+0000 7f65d8ff9640 1 -- 172.21.15.12:0/2793922221 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f65d4058ce0 con 0x7f65dc15e760 2024-09-10T09:22:32.802 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-10T09:22:32.802 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":17,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:29.739377+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65c806be30 msgr2=0x7f65c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65c806be30 0x7f65c806e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65cc034000 tx=0x7f65cc02e000 comp rx=0 tx=0).stop 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 msgr2=0x7f65dc09ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc09ebe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f65d400b9a0 tx=0x7f65d400be60 comp rx=0 tx=0).stop 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 shutdown_connections 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65c806be30 0x7f65c806e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65dc15e760 0x7f65dc09ebe0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65dc0b6ea0 0x7f65dc15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 --2- 172.21.15.12:0/2793922221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65dc06cb60 0x7f65dc0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 >> 172.21.15.12:0/2793922221 conn(0x7f65dc0b7a30 msgr2=0x7f65dc160c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 shutdown_connections 2024-09-10T09:22:32.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-10T09:22:32.803+0000 7f65e2453640 1 -- 172.21.15.12:0/2793922221 wait complete. 2024-09-10T09:22:32.814 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T09:22:32.814 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T09:22:32.814 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T09:22:32.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T09:22:32.817 INFO:tasks.ceph.mds.a:Started 2024-09-10T09:22:32.817 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T09:22:32.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T09:22:32.819 INFO:tasks.ceph.mds.c:Started 2024-09-10T09:22:32.819 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T09:22:32.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T09:22:32.822 INFO:tasks.ceph.mds.b:Started 2024-09-10T09:22:32.822 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T09:22:32.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T09:22:32.824 INFO:tasks.ceph.mds.d:Started 2024-09-10T09:22:32.825 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T09:22:32.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:22:32.893 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-10T09:22:32.896 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-09-10T09:22:32.907 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2024-09-10T09:22:32.908 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-09-10T09:22:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.931+0000 7fa18359f640 1 Processor -- start 2024-09-10T09:22:32.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.931+0000 7fa18359f640 1 -- start start 2024-09-10T09:22:32.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18359f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c1569f0 0x7fa17c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18359f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa17c0b1b50 0x7fa17c1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18359f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c0731d0 con 0x7fa17c160610 2024-09-10T09:22:32.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18359f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa17c074230 con 0x7fa17c0b1b50 2024-09-10T09:22:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18359f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c073470 con 0x7fa17c1569f0 2024-09-10T09:22:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa17c0b1b50 0x7fa17c1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18133b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c1569f0 0x7fa17c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa17c0b1b50 0x7fa17c1600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:56738/0 (socket says 172.21.15.12:56738) 2024-09-10T09:22:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 -- 172.21.15.12:0/1877260319 learned_addr learned my addr 172.21.15.12:0/1877260319 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 -- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c1569f0 msgr2=0x7fa17c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 --2- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c1569f0 0x7fa17c0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 -- 172.21.15.12:0/1877260319 >> v1:172.21.15.100:6789/0 conn(0x7fa17c160610 legacy=0x7fa17c15cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa180b3a640 1 -- 172.21.15.12:0/1877260319 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c073750 con 0x7fa17c0b1b50 2024-09-10T09:22:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.932+0000 7fa18133b640 1 --2- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c1569f0 0x7fa17c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.933+0000 7fa180b3a640 1 --2- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c0b1b50 0x7fa17c1600d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009870 tx=0x7fa16c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=294904b3cc83e408 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.933+0000 7fa173fff640 1 -- 172.21.15.12:0/1877260319 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c037070 con 0x7fa17c0b1b50 2024-09-10T09:22:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.933+0000 7fa173fff640 1 -- 172.21.15.12:0/1877260319 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16c032440 con 0x7fa17c0b1b50 2024-09-10T09:22:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.933+0000 7fa173fff640 1 -- 172.21.15.12:0/1877260319 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c032810 con 0x7fa17c0b1b50 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 -- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c0b1b50 msgr2=0x7fa17c1600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 --2- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c0b1b50 0x7fa17c1600d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009870 tx=0x7fa16c02a270 comp rx=0 tx=0).stop 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 -- 172.21.15.12:0/1877260319 shutdown_connections 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 --2- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c0b1b50 0x7fa17c1600d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 --2- 172.21.15.12:0/1877260319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c1569f0 0x7fa17c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 -- 172.21.15.12:0/1877260319 >> 172.21.15.12:0/1877260319 conn(0x7fa17c0b4220 msgr2=0x7fa17c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 -- 172.21.15.12:0/1877260319 shutdown_connections 2024-09-10T09:22:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.934+0000 7fa18359f640 1 -- 172.21.15.12:0/1877260319 wait complete. 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.935+0000 7fa18359f640 1 Processor -- start 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.935+0000 7fa18359f640 1 -- start start 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18359f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c0b1b50 0x7fa17c15f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18359f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 0x7fa17c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18359f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c160610 0x7fa17c157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18359f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0717f0 con 0x7fa17c1569f0 2024-09-10T09:22:32.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18359f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c073d10 con 0x7fa17c160610 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18359f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c156dd0 con 0x7fa17c0b1b50 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 0x7fa17c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 0x7fa17c0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36766/0 (socket says 172.21.15.12:36766) 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 -- 172.21.15.12:0/4112710132 learned_addr learned my addr 172.21.15.12:0/4112710132 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa18133b640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c0b1b50 0x7fa17c15f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa181b3c640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c160610 0x7fa17c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 -- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c0b1b50 msgr2=0x7fa17c15f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c0b1b50 0x7fa17c15f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 -- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c160610 msgr2=0x7fa17c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c160610 0x7fa17c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa180b3a640 1 -- 172.21.15.12:0/4112710132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c0d2d40 con 0x7fa17c1569f0 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.936+0000 7fa181b3c640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c160610 0x7fa17c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:32.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.937+0000 7fa180b3a640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 0x7fa17c0d1f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa16c000c00 tx=0x7fa16c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.937+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c037040 con 0x7fa17c1569f0 2024-09-10T09:22:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.937+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16c042070 con 0x7fa17c1569f0 2024-09-10T09:22:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.937+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c030880 con 0x7fa17c1569f0 2024-09-10T09:22:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.937+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c0d1430 con 0x7fa17c1569f0 2024-09-10T09:22:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.937+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c0d19f0 con 0x7fa17c1569f0 2024-09-10T09:22:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.938+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17c1600d0 con 0x7fa17c1569f0 2024-09-10T09:22:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.938+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa16c030a20 con 0x7fa17c1569f0 2024-09-10T09:22:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.939+0000 7fa171ffb640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa16006be30 0x7fa16006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.939+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa16c0ab3d0 con 0x7fa17c1569f0 2024-09-10T09:22:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.939+0000 7fa18133b640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa16006be30 0x7fa16006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:32.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.940+0000 7fa18133b640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa16006be30 0x7fa16006e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa178009560 tx=0x7fa178008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:32.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:32.943+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa16c07a0d0 con 0x7fa17c1569f0 2024-09-10T09:22:33.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.153+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa17c15fe60 con 0x7fa17c1569f0 2024-09-10T09:22:33.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.153+0000 7fa171ffb640 1 -- 172.21.15.12:0/4112710132 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7fa16c0799d0 con 0x7fa17c1569f0 2024-09-10T09:22:33.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:33.156 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"btime":"2024-09-10T09:22:32:898105+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T09:22:33.156 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-09-10T09:22:33.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa16006be30 msgr2=0x7fa16006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:33.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa16006be30 0x7fa16006e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa178009560 tx=0x7fa178008040 comp rx=0 tx=0).stop 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 msgr2=0x7fa17c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 0x7fa17c0d1f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa16c000c00 tx=0x7fa16c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 shutdown_connections 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa16006be30 0x7fa16006e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa17c160610 0x7fa17c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa17c1569f0 0x7fa17c0d1f10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 --2- 172.21.15.12:0/4112710132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa17c0b1b50 0x7fa17c15f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 >> 172.21.15.12:0/4112710132 conn(0x7fa17c0b4220 msgr2=0x7fa17c1549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 shutdown_connections 2024-09-10T09:22:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:33.155+0000 7fa18359f640 1 -- 172.21.15.12:0/4112710132 wait complete. 2024-09-10T09:22:33.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:22:33.648 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:22:35.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:22:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.282+0000 7feb625cf640 1 Processor -- start 2024-09-10T09:22:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.282+0000 7feb625cf640 1 -- start start 2024-09-10T09:22:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.283+0000 7feb625cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 0x7feb5c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.283+0000 7feb625cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c0b7170 con 0x7feb5c0cef90 2024-09-10T09:22:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.283+0000 7feb625cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c0b7aa0 con 0x7feb5c15ed20 2024-09-10T09:22:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.283+0000 7feb625cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c0d3660 con 0x7feb5c15e940 2024-09-10T09:22:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.283+0000 7feb60b6c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feb5c0cef90 0x7feb5c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54824/0 (socket says 172.21.15.12:54824) 2024-09-10T09:22:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.283+0000 7feb60b6c640 1 -- 172.21.15.12:0/2498082909 learned_addr learned my addr 172.21.15.12:0/2498082909 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5bfff640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 0x7feb5c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640065978 0 0) 0x7feb54001490 con 0x7feb5c0cef90 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb44003520 con 0x7feb5c0cef90 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3588178229 0 0) 0x7feb44003520 con 0x7feb5c0cef90 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 msgr2=0x7feb5c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 0x7feb5c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 >> v1:172.21.15.100:6789/0 conn(0x7feb5c15ed20 legacy=0x7feb5c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c0d3940 con 0x7feb5c0cef90 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7feb54001bc0 con 0x7feb5c0cef90 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 >> v1:172.21.15.12:6789/0 conn(0x7feb5c0cef90 legacy=0x7feb5c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 0x7feb440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44003f20 0x7feb44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c0d3660 con 0x7feb44004d40 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb4400ba20 con 0x7feb44003f20 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feb4400bc20 con 0x7feb5c15e940 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb60b6c640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5bfff640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 0x7feb440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.284+0000 7feb5b7fe640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44003f20 0x7feb44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb60b6c640 1 -- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 msgr2=0x7feb440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb60b6c640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c15e940 0x7feb440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb60b6c640 1 -- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44003f20 msgr2=0x7feb44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb60b6c640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb44003f20 0x7feb44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb60b6c640 1 -- 172.21.15.12:0/2498082909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb44003520 con 0x7feb44004d40 2024-09-10T09:22:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb60b6c640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb440051c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feb5400aa30 tx=0x7feb44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86a0f0b145ecb20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5400a650 con 0x7feb44004d40 2024-09-10T09:22:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5402f070 con 0x7feb44004d40 2024-09-10T09:22:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.285+0000 7feb5affd640 1 -- 172.21.15.12:0/2498082909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5402be60 con 0x7feb44004d40 2024-09-10T09:22:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb625cf640 1 -- 172.21.15.12:0/2498082909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 msgr2=0x7feb440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb625cf640 1 --2- 172.21.15.12:0/2498082909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb440051c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feb5400aa30 tx=0x7feb44005830 comp rx=0 tx=0).stop 2024-09-10T09:22:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb60b6c640 1 -- 172.21.15.12:0/2498082909 reap_dead start 2024-09-10T09:22:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb625cf640 1 -- 172.21.15.12:0/2498082909 shutdown_connections 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb625cf640 1 -- 172.21.15.12:0/2498082909 >> 172.21.15.12:0/2498082909 conn(0x7feb5c0b6240 msgr2=0x7feb5c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb625cf640 1 -- 172.21.15.12:0/2498082909 shutdown_connections 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.286+0000 7feb625cf640 1 -- 172.21.15.12:0/2498082909 wait complete. 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.287+0000 7feb625cf640 1 Processor -- start 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 -- start start 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb5c0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb5c0ca1d0 0x7feb5c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c1e97d0 0x7feb5c1e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c0d3310 con 0x7feb44004d40 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c0d3f00 con 0x7feb5c0ca1d0 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb625cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c0d1ef0 con 0x7feb5c1e97d0 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb5c0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb5c0b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36794/0 (socket says 172.21.15.12:36794) 2024-09-10T09:22:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.288+0000 7feb5bfff640 1 -- 172.21.15.12:0/1650980391 learned_addr learned my addr 172.21.15.12:0/1650980391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5b7fe640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb5c0ca1d0 0x7feb5c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb60b6c640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c1e97d0 0x7feb5c1e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5bfff640 1 -- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c1e97d0 msgr2=0x7feb5c1e9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5bfff640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c1e97d0 0x7feb5c1e9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5bfff640 1 -- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb5c0ca1d0 msgr2=0x7feb5c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5bfff640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb5c0ca1d0 0x7feb5c0ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5bfff640 1 -- 172.21.15.12:0/1650980391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c0cac90 con 0x7feb44004d40 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb5bfff640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb5c0b4bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0119a0 tx=0x7feb4c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00faf0 con 0x7feb44004d40 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c00fc90 con 0x7feb44004d40 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c014440 con 0x7feb44004d40 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c14aac0 con 0x7feb44004d40 2024-09-10T09:22:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.289+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c14b080 con 0x7feb44004d40 2024-09-10T09:22:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.290+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c14a8b0 con 0x7feb44004d40 2024-09-10T09:22:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.291+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb4c012040 con 0x7feb44004d40 2024-09-10T09:22:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.291+0000 7feb58ff9640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feb4806be30 0x7feb4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.291+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7feb4c08b270 con 0x7feb44004d40 2024-09-10T09:22:35.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.291+0000 7feb5b7fe640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feb4806be30 0x7feb4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.292+0000 7feb5b7fe640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feb4806be30 0x7feb4806e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feb5c150fc0 tx=0x7feb50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.296+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb4c019030 con 0x7feb44004d40 2024-09-10T09:22:35.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.506+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb5c0d1060 con 0x7feb44004d40 2024-09-10T09:22:35.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.506+0000 7feb58ff9640 1 -- 172.21.15.12:0/1650980391 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7feb4c059890 con 0x7feb44004d40 2024-09-10T09:22:35.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:35.508 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"btime":"2024-09-10T09:22:33:900687+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4306,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T09:22:35.509 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-09-10T09:22:35.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feb4806be30 msgr2=0x7feb4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feb4806be30 0x7feb4806e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feb5c150fc0 tx=0x7feb50009040 comp rx=0 tx=0).stop 2024-09-10T09:22:35.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 msgr2=0x7feb5c0b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb5c0b4bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0119a0 tx=0x7feb4c011e60 comp rx=0 tx=0).stop 2024-09-10T09:22:35.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 shutdown_connections 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feb4806be30 0x7feb4806e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb5c1e97d0 0x7feb5c1e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb5c0ca1d0 0x7feb5c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 --2- 172.21.15.12:0/1650980391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb44004d40 0x7feb5c0b4bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 >> 172.21.15.12:0/1650980391 conn(0x7feb5c0b6240 msgr2=0x7feb5c0cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 shutdown_connections 2024-09-10T09:22:35.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.508+0000 7feb625cf640 1 -- 172.21.15.12:0/1650980391 wait complete. 2024-09-10T09:22:35.521 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T09:22:35.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.621+0000 7f3f1764c640 1 Processor -- start 2024-09-10T09:22:35.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f1764c640 1 -- start start 2024-09-10T09:22:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f1764c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f1015ed20 0x7f3f100b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f1764c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3f100cef90 0x7f3f100b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f1764c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f100b7170 con 0x7f3f1015e940 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f1764c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3f100b7aa0 con 0x7f3f1015ed20 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f1764c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3f100d3660 con 0x7f3f100cef90 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.622+0000 7f3f14be7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f1015ed20 0x7f3f100b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f153e8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3f1015e940 0x7f3f100d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54840/0 (socket says 172.21.15.12:54840) 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f153e8640 1 -- 172.21.15.12:0/2042942306 learned_addr learned my addr 172.21.15.12:0/2042942306 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f15be9640 1 --2- 172.21.15.12:0/2042942306 >> v2:172.21.15.100:3300/0 conn(0x7f3f100cef90 0x7f3f100b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f14be7640 1 -- 172.21.15.12:0/2042942306 >> v2:172.21.15.100:3300/0 conn(0x7f3f100cef90 msgr2=0x7f3f100b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f14be7640 1 --2- 172.21.15.12:0/2042942306 >> v2:172.21.15.100:3300/0 conn(0x7f3f100cef90 0x7f3f100b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f14be7640 1 -- 172.21.15.12:0/2042942306 >> v1:172.21.15.12:6789/0 conn(0x7f3f1015e940 legacy=0x7f3f100d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f14be7640 1 -- 172.21.15.12:0/2042942306 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f100d3940 con 0x7f3f1015ed20 2024-09-10T09:22:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.623+0000 7f3f0ffff640 1 -- 172.21.15.12:0/2042942306 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180488604 0 0) 0x7f3f00001490 con 0x7f3f1015e940 2024-09-10T09:22:35.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f14be7640 1 --2- 172.21.15.12:0/2042942306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100b3220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f1006d070 tx=0x7f3f0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8711812300269335 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f0ffff640 1 -- 172.21.15.12:0/2042942306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04037070 con 0x7f3f1015ed20 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f0ffff640 1 -- 172.21.15.12:0/2042942306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f04032440 con 0x7f3f1015ed20 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f0ffff640 1 -- 172.21.15.12:0/2042942306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04032810 con 0x7f3f1015ed20 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 -- 172.21.15.12:0/2042942306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 msgr2=0x7f3f100b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 --2- 172.21.15.12:0/2042942306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100b3220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f1006d070 tx=0x7f3f0402a230 comp rx=0 tx=0).stop 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 -- 172.21.15.12:0/2042942306 shutdown_connections 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 --2- 172.21.15.12:0/2042942306 >> v2:172.21.15.100:3300/0 conn(0x7f3f100cef90 0x7f3f100b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 --2- 172.21.15.12:0/2042942306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100b3220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 -- 172.21.15.12:0/2042942306 >> 172.21.15.12:0/2042942306 conn(0x7f3f100b6240 msgr2=0x7f3f100b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 -- 172.21.15.12:0/2042942306 shutdown_connections 2024-09-10T09:22:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.624+0000 7f3f1764c640 1 -- 172.21.15.12:0/2042942306 wait complete. 2024-09-10T09:22:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 Processor -- start 2024-09-10T09:22:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 -- start start 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f100cef90 0x7f3f1014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f1015e940 0x7f3f100ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f100d3310 con 0x7f3f1015ed20 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f100d3f00 con 0x7f3f1015e940 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f1764c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3f100d1ef0 con 0x7f3f100cef90 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f15be9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f15be9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36798/0 (socket says 172.21.15.12:36798) 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f15be9640 1 -- 172.21.15.12:0/3950905032 learned_addr learned my addr 172.21.15.12:0/3950905032 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f14be7640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f1015e940 0x7f3f100ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.626+0000 7f3f153e8640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f100cef90 0x7f3f1014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f15be9640 1 -- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f100cef90 msgr2=0x7f3f1014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f15be9640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f100cef90 0x7f3f1014eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f15be9640 1 -- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f1015e940 msgr2=0x7f3f100ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f15be9640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f1015e940 0x7f3f100ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f15be9640 1 -- 172.21.15.12:0/3950905032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f100ce010 con 0x7f3f1015ed20 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f15be9640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100ab6e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c820 tx=0x7f3f0800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08015070 con 0x7f3f1015ed20 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f08004020 con 0x7f3f1015ed20 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f100ce2f0 con 0x7f3f1015ed20 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004410 con 0x7f3f1015ed20 2024-09-10T09:22:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.627+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101594d0 con 0x7f3f1015ed20 2024-09-10T09:22:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.628+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f100d1060 con 0x7f3f1015ed20 2024-09-10T09:22:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.629+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f08007830 con 0x7f3f1015ed20 2024-09-10T09:22:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.629+0000 7f3f0dffb640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f3efc06be30 0x7f3efc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.629+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3f0808a970 con 0x7f3f1015ed20 2024-09-10T09:22:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.630+0000 7f3f153e8640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f3efc06be30 0x7f3efc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.630+0000 7f3f153e8640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f3efc06be30 0x7f3efc06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f000012e0 tx=0x7f3f00007ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.634+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f08058f80 con 0x7f3f1015ed20 2024-09-10T09:22:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.811+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3f100ba6b0 con 0x7f3f1015ed20 2024-09-10T09:22:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.812+0000 7f3f0dffb640 1 -- 172.21.15.12:0/3950905032 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f3f0805d280 con 0x7f3f1015ed20 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:22:35.814 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f3efc06be30 msgr2=0x7f3efc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f3efc06be30 0x7f3efc06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f000012e0 tx=0x7f3f00007ed0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 msgr2=0x7f3f100ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100ab6e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c820 tx=0x7f3f0800cce0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 shutdown_connections 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f3efc06be30 0x7f3efc06e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f1015ed20 0x7f3f100ab6e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f1015e940 0x7f3f100ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 --2- 172.21.15.12:0/3950905032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f100cef90 0x7f3f1014eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 >> 172.21.15.12:0/3950905032 conn(0x7f3f100b6240 msgr2=0x7f3f100cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 shutdown_connections 2024-09-10T09:22:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.814+0000 7f3f1764c640 1 -- 172.21.15.12:0/3950905032 wait complete. 2024-09-10T09:22:35.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T09:22:35.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T09:22:35.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.931+0000 7fbc530e4640 1 Processor -- start 2024-09-10T09:22:35.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.931+0000 7fbc530e4640 1 -- start start 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc530e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc4c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc530e4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4c0d20e0 con 0x7fbc4c0b3540 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc530e4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4c0cfa70 con 0x7fbc4c0b61e0 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc530e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c0d24f0 con 0x7fbc4c0b3b00 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc51681640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbc4c0b3540 0x7fbc4c0d2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54850/0 (socket says 172.21.15.12:54850) 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc51681640 1 -- 172.21.15.12:0/3747520746 learned_addr learned my addr 172.21.15.12:0/3747520746 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.932+0000 7fbc4bfff640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc4c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2488458553 0 0) 0x7fbc4c0d20e0 con 0x7fbc4c0b3540 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc34003520 con 0x7fbc4c0b3540 2024-09-10T09:22:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3513753645 0 0) 0x7fbc34003520 con 0x7fbc4c0b3540 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 msgr2=0x7fbc4c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc4c0d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 >> v1:172.21.15.100:6789/0 conn(0x7fbc4c0b61e0 legacy=0x7fbc4c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c0cfd50 con 0x7fbc4c0b3540 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fbc440019f0 con 0x7fbc4c0b3540 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 >> v1:172.21.15.12:6789/0 conn(0x7fbc4c0b3540 legacy=0x7fbc4c0d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc34003f20 0x7fbc34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0d24f0 con 0x7fbc34004d40 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3400bb80 con 0x7fbc34003f20 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3400bd80 con 0x7fbc4c0b3b00 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc51681640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc50e80640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc4bfff640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc34003f20 0x7fbc34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc51681640 1 -- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 msgr2=0x7fbc340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc51681640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc51681640 1 -- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc34003f20 msgr2=0x7fbc34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc51681640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc34003f20 0x7fbc34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc51681640 1 -- 172.21.15.12:0/3747520746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc34003520 con 0x7fbc34004d40 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.933+0000 7fbc50e80640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0b3b00 0x7fbc340039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.934+0000 7fbc51681640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc340051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400a810 tx=0x7fbc34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37c3a9e53ea808e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.934+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400a430 con 0x7fbc34004d40 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.934+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4402f070 con 0x7fbc34004d40 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.934+0000 7fbc4b7fe640 1 -- 172.21.15.12:0/3747520746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4402bc90 con 0x7fbc34004d40 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc530e4640 1 -- 172.21.15.12:0/3747520746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 msgr2=0x7fbc340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc530e4640 1 --2- 172.21.15.12:0/3747520746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc340051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400a810 tx=0x7fbc34005830 comp rx=0 tx=0).stop 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc51681640 1 -- 172.21.15.12:0/3747520746 reap_dead start 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc530e4640 1 -- 172.21.15.12:0/3747520746 shutdown_connections 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc530e4640 1 -- 172.21.15.12:0/3747520746 >> 172.21.15.12:0/3747520746 conn(0x7fbc4c0d11e0 msgr2=0x7fbc4c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc530e4640 1 -- 172.21.15.12:0/3747520746 shutdown_connections 2024-09-10T09:22:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.935+0000 7fbc530e4640 1 -- 172.21.15.12:0/3747520746 wait complete. 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.936+0000 7fbc530e4640 1 Processor -- start 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.936+0000 7fbc530e4640 1 -- start start 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc530e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc4c0b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc530e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c162c00 0x7fbc4c1f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc530e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0ad3e0 0x7fbc4c0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc530e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c15edc0 con 0x7fbc34004d40 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc530e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0d1d00 con 0x7fbc4c162c00 2024-09-10T09:22:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc530e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c1f4e60 con 0x7fbc4c0ad3e0 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc4c0b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc4c0b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36824/0 (socket says 172.21.15.12:36824) 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 -- 172.21.15.12:0/863809701 learned_addr learned my addr 172.21.15.12:0/863809701 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc4bfff640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c162c00 0x7fbc4c1f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc51681640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0ad3e0 0x7fbc4c0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 -- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0ad3e0 msgr2=0x7fbc4c0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0ad3e0 0x7fbc4c0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 -- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c162c00 msgr2=0x7fbc4c1f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c162c00 0x7fbc4c1f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.937+0000 7fbc50e80640 1 -- 172.21.15.12:0/863809701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c1f8920 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.938+0000 7fbc50e80640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc4c0b2980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00f900 tx=0x7fbc3c00fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.938+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0052e0 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.938+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c018070 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.938+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c163090 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.938+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00d970 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.938+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c1f4af0 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.939+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4c0cfa70 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.939+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc3c00db10 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.940+0000 7fbc497fa640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.940+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbc3c08aa70 con 0x7fbc34004d40 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.940+0000 7fbc4bfff640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.940+0000 7fbc4bfff640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbc3806be30 0x7fbc3806e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c163370 tx=0x7fbc40009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:35.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:35.944+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc3c059800 con 0x7fbc34004d40 2024-09-10T09:22:36.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.120+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbc4c0ba6e0 con 0x7fbc34004d40 2024-09-10T09:22:36.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.911+0000 7fbc497fa640 1 -- 172.21.15.12:0/863809701 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fbc3c059100 con 0x7fbc34004d40 2024-09-10T09:22:36.913 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-10T09:22:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbc3806be30 msgr2=0x7fbc3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbc3806be30 0x7fbc3806e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c163370 tx=0x7fbc40009190 comp rx=0 tx=0).stop 2024-09-10T09:22:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 msgr2=0x7fbc4c0b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc4c0b2980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00f900 tx=0x7fbc3c00fd00 comp rx=0 tx=0).stop 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 shutdown_connections 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbc3806be30 0x7fbc3806e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc4c0ad3e0 0x7fbc4c0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c162c00 0x7fbc4c1f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 --2- 172.21.15.12:0/863809701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc34004d40 0x7fbc4c0b2980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.914+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 >> 172.21.15.12:0/863809701 conn(0x7fbc4c0d11e0 msgr2=0x7fbc4c0d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.915+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 shutdown_connections 2024-09-10T09:22:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:36.915+0000 7fbc530e4640 1 -- 172.21.15.12:0/863809701 wait complete. 2024-09-10T09:22:36.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T09:22:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.050+0000 7fe23039f640 1 Processor -- start 2024-09-10T09:22:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.050+0000 7fe23039f640 1 -- start start 2024-09-10T09:22:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe23039f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe23039f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe22815f9f0 0x7fe2280ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe23039f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22815c970 con 0x7fe22815b370 2024-09-10T09:22:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe23039f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe22815fef0 con 0x7fe22815f9f0 2024-09-10T09:22:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe23039f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe22815bbb0 con 0x7fe22806f130 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e93c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe22815f9f0 0x7fe2280ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e13b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe22815b370 0x7fe22806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54866/0 (socket says 172.21.15.12:54866) 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e13b640 1 -- 172.21.15.12:0/2448964958 learned_addr learned my addr 172.21.15.12:0/2448964958 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22d93a640 1 --2- 172.21.15.12:0/2448964958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e93c640 1 -- 172.21.15.12:0/2448964958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 msgr2=0x7fe228072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e93c640 1 --2- 172.21.15.12:0/2448964958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e93c640 1 -- 172.21.15.12:0/2448964958 >> v1:172.21.15.12:6789/0 conn(0x7fe22815b370 legacy=0x7fe22806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22d139640 1 -- 172.21.15.12:0/2448964958 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156894188 0 0) 0x7fe22815c970 con 0x7fe22815b370 2024-09-10T09:22:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.051+0000 7fe22e93c640 1 -- 172.21.15.12:0/2448964958 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22815be90 con 0x7fe22815f9f0 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.052+0000 7fe22e93c640 1 --2- 172.21.15.12:0/2448964958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815f9f0 0x7fe2280ce490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe228160070 tx=0x7fe22002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cfdca94a035042 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.052+0000 7fe22d139640 1 -- 172.21.15.12:0/2448964958 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220007740 con 0x7fe22815f9f0 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.052+0000 7fe22d139640 1 -- 172.21.15.12:0/2448964958 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2200078e0 con 0x7fe22815f9f0 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.052+0000 7fe22d139640 1 -- 172.21.15.12:0/2448964958 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220007cb0 con 0x7fe22815f9f0 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 -- 172.21.15.12:0/2448964958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815f9f0 msgr2=0x7fe2280ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 --2- 172.21.15.12:0/2448964958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815f9f0 0x7fe2280ce490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe228160070 tx=0x7fe22002a5b0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 -- 172.21.15.12:0/2448964958 shutdown_connections 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 --2- 172.21.15.12:0/2448964958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815f9f0 0x7fe2280ce490 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 --2- 172.21.15.12:0/2448964958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 -- 172.21.15.12:0/2448964958 >> 172.21.15.12:0/2448964958 conn(0x7fe22806bba0 msgr2=0x7fe22806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 -- 172.21.15.12:0/2448964958 shutdown_connections 2024-09-10T09:22:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.053+0000 7fe23039f640 1 -- 172.21.15.12:0/2448964958 wait complete. 2024-09-10T09:22:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.054+0000 7fe23039f640 1 Processor -- start 2024-09-10T09:22:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.054+0000 7fe23039f640 1 -- start start 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe23039f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe23039f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 0x7fe2281561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe23039f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22815f9f0 0x7fe2280b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe23039f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2280731b0 con 0x7fe22815b370 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe23039f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe22815c450 con 0x7fe22815f9f0 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe23039f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe22815b750 con 0x7fe22806f130 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 0x7fe2281561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 0x7fe2281561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36838/0 (socket says 172.21.15.12:36838) 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 -- 172.21.15.12:0/1765827429 learned_addr learned my addr 172.21.15.12:0/1765827429 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22e13b640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22e93c640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22815f9f0 0x7fe2280b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 -- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 msgr2=0x7fe228155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 -- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22815f9f0 msgr2=0x7fe2280b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22815f9f0 0x7fe2280b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22d93a640 1 -- 172.21.15.12:0/1765827429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2280ab0f0 con 0x7fe22815b370 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22e93c640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22815f9f0 0x7fe2280b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.055+0000 7fe22e13b640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.056+0000 7fe22d93a640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 0x7fe2281561b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe21800e930 tx=0x7fe21800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.056+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218017070 con 0x7fe22815b370 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.056+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21800ca00 con 0x7fe22815b370 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.056+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2280ab3d0 con 0x7fe22815b370 2024-09-10T09:22:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.056+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21800cdf0 con 0x7fe22815b370 2024-09-10T09:22:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.056+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2280ab990 con 0x7fe22815b370 2024-09-10T09:22:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.057+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2280abb90 con 0x7fe22815b370 2024-09-10T09:22:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.057+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe21801a070 con 0x7fe22815b370 2024-09-10T09:22:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.058+0000 7fe21effd640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe20c06be30 0x7fe20c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.058+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fe21808aff0 con 0x7fe22815b370 2024-09-10T09:22:37.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.058+0000 7fe22e13b640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe20c06be30 0x7fe20c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:37.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.059+0000 7fe22e13b640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe20c06be30 0x7fe20c06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f60 tx=0x7fe224007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.062+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2280abb90 con 0x7fe22815b370 2024-09-10T09:22:37.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.239+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe228072560 con 0x7fe22815b370 2024-09-10T09:22:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.914+0000 7fe21effd640 1 -- 172.21.15.12:0/1765827429 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fe218059c90 con 0x7fe22815b370 2024-09-10T09:22:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-10T09:22:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.917+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe20c06be30 msgr2=0x7fe20c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.917+0000 7fe23039f640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe20c06be30 0x7fe20c06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe224000f60 tx=0x7fe224007c10 comp rx=0 tx=0).stop 2024-09-10T09:22:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.917+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 msgr2=0x7fe2281561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.917+0000 7fe23039f640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 0x7fe2281561b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe21800e930 tx=0x7fe21800edf0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 shutdown_connections 2024-09-10T09:22:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe20c06be30 0x7fe20c06e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe22815f9f0 0x7fe2280b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe22815b370 0x7fe2281561b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 --2- 172.21.15.12:0/1765827429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe22806f130 0x7fe228155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 >> 172.21.15.12:0/1765827429 conn(0x7fe22806bba0 msgr2=0x7fe2280cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 shutdown_connections 2024-09-10T09:22:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:37.918+0000 7fe23039f640 1 -- 172.21.15.12:0/1765827429 wait complete. 2024-09-10T09:22:37.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T09:22:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.057+0000 7f2345913640 1 Processor -- start 2024-09-10T09:22:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.057+0000 7f2345913640 1 -- start start 2024-09-10T09:22:38.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f2345913640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23400cf750 0x7f234006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:38.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f2345913640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234015e9d0 con 0x7f23400d2d10 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f2345913640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234006ca70 con 0x7f23400b3430 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f2345913640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f23400d22c0 con 0x7f23400cf750 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f233f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f23400d2d10 0x7f23400d3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54878/0 (socket says 172.21.15.12:54878) 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f233f7fe640 1 -- 172.21.15.12:0/2234224600 learned_addr learned my addr 172.21.15.12:0/2234224600 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f233e7fc640 1 --2- 172.21.15.12:0/2234224600 >> v2:172.21.15.100:3300/0 conn(0x7f23400cf750 0x7f234006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.058+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519064386 0 0) 0x7f234015e9d0 con 0x7f23400d2d10 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232c003520 con 0x7f23400d2d10 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556860923 0 0) 0x7f234006ca70 con 0x7f23400b3430 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f234015e9d0 con 0x7f23400b3430 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233e7fc640 1 -- 172.21.15.12:0/2234224600 >> v1:172.21.15.100:6789/0 conn(0x7f23400b3430 legacy=0x7f23400b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233e7fc640 1 -- 172.21.15.12:0/2234224600 >> v1:172.21.15.12:6789/0 conn(0x7f23400d2d10 legacy=0x7f23400d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1686307425 0 0) 0x7f232c003520 con 0x7f23400d2d10 2024-09-10T09:22:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.059+0000 7f233e7fc640 1 -- 172.21.15.12:0/2234224600 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234006cd50 con 0x7f23400cf750 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f233e7fc640 1 --2- 172.21.15.12:0/2234224600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400cf750 0x7f234006c2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23280097a0 tx=0x7f232802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e786a7efd4dfd95a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328037070 con 0x7f23400cf750 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232802abc0 con 0x7f23400cf750 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f233dffb640 1 -- 172.21.15.12:0/2234224600 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23300019f0 con 0x7f23400cf750 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 -- 172.21.15.12:0/2234224600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400cf750 msgr2=0x7f234006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 --2- 172.21.15.12:0/2234224600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400cf750 0x7f234006c2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23280097a0 tx=0x7f232802a130 comp rx=0 tx=0).stop 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 -- 172.21.15.12:0/2234224600 shutdown_connections 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 --2- 172.21.15.12:0/2234224600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400cf750 0x7f234006c2d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 -- 172.21.15.12:0/2234224600 >> 172.21.15.12:0/2234224600 conn(0x7f23400d4b10 msgr2=0x7f23400d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 -- 172.21.15.12:0/2234224600 shutdown_connections 2024-09-10T09:22:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.060+0000 7f2345913640 1 -- 172.21.15.12:0/2234224600 wait complete. 2024-09-10T09:22:38.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.062+0000 7f2345913640 1 Processor -- start 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.062+0000 7f2345913640 1 -- start start 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.062+0000 7f2345913640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400b3430 0x7f23401617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2345913640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 0x7f23400c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2345913640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23400d2d10 0x7f23401f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2345913640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f234006c810 con 0x7f23400cf750 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2345913640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23400cfbc0 con 0x7f23400b3430 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2345913640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f23400d27f0 con 0x7f23400d2d10 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 0x7f23400c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 0x7f23400c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36854/0 (socket says 172.21.15.12:36854) 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 -- 172.21.15.12:0/3113490480 learned_addr learned my addr 172.21.15.12:0/3113490480 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233effd640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400b3430 0x7f23401617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233f7fe640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23400d2d10 0x7f23401f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 -- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23400d2d10 msgr2=0x7f23401f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23400d2d10 0x7f23401f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 -- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400b3430 msgr2=0x7f23401617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400b3430 0x7f23401617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 -- 172.21.15.12:0/3113490480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400c8350 con 0x7f23400cf750 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f233e7fc640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 0x7f23400c9110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2328035040 tx=0x7f23280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328037050 con 0x7f23400cf750 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2328043070 con 0x7f23400cf750 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23400c8630 con 0x7f23400cf750 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.063+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328006e10 con 0x7f23400cf750 2024-09-10T09:22:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.064+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400c8bf0 con 0x7f23400cf750 2024-09-10T09:22:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.065+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23400d0900 con 0x7f23400cf750 2024-09-10T09:22:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.065+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2328048460 con 0x7f23400cf750 2024-09-10T09:22:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.066+0000 7f2337fff640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.066+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f23280ab260 con 0x7f23400cf750 2024-09-10T09:22:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.066+0000 7f233effd640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.066+0000 7f233effd640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f232006be30 0x7f232006e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23380011e0 tx=0x7f2338009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:38.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.070+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23400d0900 con 0x7f23400cf750 2024-09-10T09:22:38.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.283+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f23400cfd40 con 0x7f23400cf750 2024-09-10T09:22:38.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.950+0000 7f2337fff640 1 -- 172.21.15.12:0/3113490480 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f232804d020 con 0x7f23400cf750 2024-09-10T09:22:38.952 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T09:22:38.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.959+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f232006be30 msgr2=0x7f232006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.959+0000 7f2345913640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f232006be30 0x7f232006e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23380011e0 tx=0x7f2338009040 comp rx=0 tx=0).stop 2024-09-10T09:22:38.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 msgr2=0x7f23400c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:38.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 0x7f23400c9110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2328035040 tx=0x7f23280046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 shutdown_connections 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f232006be30 0x7f232006e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23400d2d10 0x7f23401f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23400cf750 0x7f23400c9110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 --2- 172.21.15.12:0/3113490480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23400b3430 0x7f23401617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 >> 172.21.15.12:0/3113490480 conn(0x7f23400d4b10 msgr2=0x7f234015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.960+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 shutdown_connections 2024-09-10T09:22:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:38.961+0000 7f2345913640 1 -- 172.21.15.12:0/3113490480 wait complete. 2024-09-10T09:22:38.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.088+0000 7fa4f3fff640 1 Processor -- start 2024-09-10T09:22:39.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.088+0000 7fa4f3fff640 1 -- start start 2024-09-10T09:22:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40d4ae0 0x7fa4f40d4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4f40b7740 0x7fa4f4162220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f3fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4f40d3ff0 0x7fa4f4162760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f3fff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f40d1f40 con 0x7fa4f40b7740 2024-09-10T09:22:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f3fff640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f40d5400 con 0x7fa4f40d3ff0 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f3fff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f40d1c60 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4f40b7740 0x7fa4f4162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4f40b7740 0x7fa4f4162220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36866/0 (socket says 172.21.15.12:36866) 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 -- 172.21.15.12:0/677451506 learned_addr learned my addr 172.21.15.12:0/677451506 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f2ffd640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40d4ae0 0x7fa4f40d4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f37fe640 1 --2- 172.21.15.12:0/677451506 >> v2:172.21.15.100:3300/0 conn(0x7fa4f40d3ff0 0x7fa4f4162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 -- 172.21.15.12:0/677451506 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40d4ae0 msgr2=0x7fa4f40d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40d4ae0 0x7fa4f40d4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 -- 172.21.15.12:0/677451506 >> v2:172.21.15.100:3300/0 conn(0x7fa4f40d3ff0 msgr2=0x7fa4f4162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 --2- 172.21.15.12:0/677451506 >> v2:172.21.15.100:3300/0 conn(0x7fa4f40d3ff0 0x7fa4f4162760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f27fc640 1 -- 172.21.15.12:0/677451506 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f40cf680 con 0x7fa4f40b7740 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.089+0000 7fa4f2ffd640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40d4ae0 0x7fa4f40d4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.090+0000 7fa4f27fc640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40b7740 0x7fa4f4162220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40cf1b0 tx=0x7fa4e802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebed42379b7b4eae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.090+0000 7fa4f1ffb640 1 -- 172.21.15.12:0/677451506 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8037070 con 0x7fa4f40b7740 2024-09-10T09:22:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.090+0000 7fa4f1ffb640 1 -- 172.21.15.12:0/677451506 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e802ae00 con 0x7fa4f40b7740 2024-09-10T09:22:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.090+0000 7fa4f1ffb640 1 -- 172.21.15.12:0/677451506 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8032660 con 0x7fa4f40b7740 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.090+0000 7fa4f3fff640 1 -- 172.21.15.12:0/677451506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40b7740 msgr2=0x7fa4f4162220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.090+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40b7740 0x7fa4f4162220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40cf1b0 tx=0x7fa4e802a0b0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 -- 172.21.15.12:0/677451506 shutdown_connections 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/677451506 >> v2:172.21.15.100:3300/0 conn(0x7fa4f40d3ff0 0x7fa4f4162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40b7740 0x7fa4f4162220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/677451506 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40d4ae0 0x7fa4f40d4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 -- 172.21.15.12:0/677451506 >> 172.21.15.12:0/677451506 conn(0x7fa4f4062a50 msgr2=0x7fa4f4062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 -- 172.21.15.12:0/677451506 shutdown_connections 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.091+0000 7fa4f3fff640 1 -- 172.21.15.12:0/677451506 wait complete. 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.092+0000 7fa4f3fff640 1 Processor -- start 2024-09-10T09:22:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.092+0000 7fa4f3fff640 1 -- start start 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40b7740 0x7fa4f41f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4f40d3ff0 0x7fa4f41f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 0x7fa4f40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4161f10 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f40cfc40 con 0x7fa4f40d3ff0 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f40d18c0 con 0x7fa4f40b7740 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 0x7fa4f40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 0x7fa4f40ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36880/0 (socket says 172.21.15.12:36880) 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 -- 172.21.15.12:0/1470197114 learned_addr learned my addr 172.21.15.12:0/1470197114 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f2ffd640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40b7740 0x7fa4f41f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f27fc640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4f40d3ff0 0x7fa4f41f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 -- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40b7740 msgr2=0x7fa4f41f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40b7740 0x7fa4f41f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 -- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4f40d3ff0 msgr2=0x7fa4f41f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4f40d3ff0 0x7fa4f41f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 -- 172.21.15.12:0/1470197114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f41f5080 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f27fc640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4f40d3ff0 0x7fa4f41f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f37fe640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 0x7fa4f40ccea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00cb80 tx=0x7fa4ec00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec015070 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec00abd0 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f41f47e0 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.093+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00d040 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.094+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f41f4da0 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.094+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f40b3720 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.095+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4ec018070 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.095+0000 7fa4db7fe640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4e006be30 0x7fa4e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.096+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa4ec08aab0 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.096+0000 7fa4f2ffd640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4e006be30 0x7fa4e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.096+0000 7fa4f2ffd640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4e006be30 0x7fa4e006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400a990 tx=0x7fa4e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.100+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4ec059460 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.281+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4f40d3dd0 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.282+0000 7fa4db7fe640 1 -- 172.21.15.12:0/1470197114 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16690 (secure 0 0 0) 0x7fa4ec058d60 con 0x7fa4f40d4ae0 2024-09-10T09:22:39.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:39.284 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:38.285156+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4e006be30 msgr2=0x7fa4e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4e006be30 0x7fa4e006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400a990 tx=0x7fa4e4008040 comp rx=0 tx=0).stop 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 msgr2=0x7fa4f40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 0x7fa4f40ccea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00cb80 tx=0x7fa4ec00a4c0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 shutdown_connections 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4e006be30 0x7fa4e006e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4f40d4ae0 0x7fa4f40ccea0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4f40d3ff0 0x7fa4f41f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 --2- 172.21.15.12:0/1470197114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4f40b7740 0x7fa4f41f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 >> 172.21.15.12:0/1470197114 conn(0x7fa4f4062a50 msgr2=0x7fa4f40b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 shutdown_connections 2024-09-10T09:22:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.284+0000 7fa4f3fff640 1 -- 172.21.15.12:0/1470197114 wait complete. 2024-09-10T09:22:39.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:39.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.397+0000 7fe2456c9640 1 Processor -- start 2024-09-10T09:22:39.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.397+0000 7fe2456c9640 1 -- start start 2024-09-10T09:22:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe2456c9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe24006c2b0 0x7fe24015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe2456c9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2400b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe2456c9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24015fbf0 con 0x7fe240148330 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe2456c9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400b4f80 con 0x7fe24006c2b0 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe2456c9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400b5260 con 0x7fe24015f400 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe23e7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe24006c2b0 0x7fe24015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.398+0000 7fe23effd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe240148330 0x7fe24006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54884/0 (socket says 172.21.15.12:54884) 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23effd640 1 -- 172.21.15.12:0/2861764497 learned_addr learned my addr 172.21.15.12:0/2861764497 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23f7fe640 1 --2- 172.21.15.12:0/2861764497 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2400b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23e7fc640 1 -- 172.21.15.12:0/2861764497 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 msgr2=0x7fe2400b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23e7fc640 1 --2- 172.21.15.12:0/2861764497 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2400b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23e7fc640 1 -- 172.21.15.12:0/2861764497 >> v1:172.21.15.12:6789/0 conn(0x7fe240148330 legacy=0x7fe24006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23e7fc640 1 -- 172.21.15.12:0/2861764497 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2400b5540 con 0x7fe24006c2b0 2024-09-10T09:22:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23dffb640 1 -- 172.21.15.12:0/2861764497 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843080066 0 0) 0x7fe24015fbf0 con 0x7fe240148330 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.399+0000 7fe23e7fc640 1 --2- 172.21.15.12:0/2861764497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe24015eec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097a0 tx=0x7fe22802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08ba7dd7f47a0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe23dffb640 1 -- 172.21.15.12:0/2861764497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228037070 con 0x7fe24006c2b0 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe23dffb640 1 -- 172.21.15.12:0/2861764497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22802ae50 con 0x7fe24006c2b0 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe23dffb640 1 -- 172.21.15.12:0/2861764497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228032660 con 0x7fe24006c2b0 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 -- 172.21.15.12:0/2861764497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 msgr2=0x7fe24015eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2861764497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe24015eec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097a0 tx=0x7fe22802a100 comp rx=0 tx=0).stop 2024-09-10T09:22:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 -- 172.21.15.12:0/2861764497 shutdown_connections 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2861764497 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2400b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2861764497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe24015eec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 -- 172.21.15.12:0/2861764497 >> 172.21.15.12:0/2861764497 conn(0x7fe240062a80 msgr2=0x7fe24006ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 -- 172.21.15.12:0/2861764497 shutdown_connections 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.400+0000 7fe2456c9640 1 -- 172.21.15.12:0/2861764497 wait complete. 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 Processor -- start 2024-09-10T09:22:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 -- start start 2024-09-10T09:22:39.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe240144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe240148330 0x7fe2400cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2401f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe24015fe50 con 0x7fe24006c2b0 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe24015f8b0 con 0x7fe240148330 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.402+0000 7fe2456c9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe24015ffd0 con 0x7fe24015f400 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe240144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe240144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36906/0 (socket says 172.21.15.12:36906) 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 -- 172.21.15.12:0/2675633582 learned_addr learned my addr 172.21.15.12:0/2675633582 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23e7fc640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe240148330 0x7fe2400cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23f7fe640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2401f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 -- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 msgr2=0x7fe2401f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2401f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 -- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe240148330 msgr2=0x7fe2400cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe240148330 0x7fe2400cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 -- 172.21.15.12:0/2675633582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2401449a0 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23e7fc640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe240148330 0x7fe2400cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe23effd640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe240144460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c4d0 tx=0x7fe23800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238018070 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe238007500 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238004a20 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe240156120 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.403+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2401566e0 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.404+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24015eec0 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.405+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe238004bc0 con 0x7fe24006c2b0 2024-09-10T09:22:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.405+0000 7fe2377fe640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe22006be30 0x7fe22006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.405+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe23808a140 con 0x7fe24006c2b0 2024-09-10T09:22:39.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.405+0000 7fe23e7fc640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe22006be30 0x7fe22006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.406+0000 7fe23e7fc640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe22006be30 0x7fe22006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe228034000 tx=0x7fe22802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.410+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe238058af0 con 0x7fe24006c2b0 2024-09-10T09:22:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.586+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe24006d0a0 con 0x7fe24006c2b0 2024-09-10T09:22:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.587+0000 7fe2377fe640 1 -- 172.21.15.12:0/2675633582 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16690 (secure 0 0 0) 0x7fe2380583f0 con 0x7fe24006c2b0 2024-09-10T09:22:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:39.589 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:38.285156+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe22006be30 msgr2=0x7fe22006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe22006be30 0x7fe22006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe228034000 tx=0x7fe22802e000 comp rx=0 tx=0).stop 2024-09-10T09:22:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 msgr2=0x7fe240144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe240144460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c4d0 tx=0x7fe23800c990 comp rx=0 tx=0).stop 2024-09-10T09:22:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 shutdown_connections 2024-09-10T09:22:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe22006be30 0x7fe22006e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe24015f400 0x7fe2401f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe240148330 0x7fe2400cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 --2- 172.21.15.12:0/2675633582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24006c2b0 0x7fe240144460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 >> 172.21.15.12:0/2675633582 conn(0x7fe240062a80 msgr2=0x7fe2401475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 shutdown_connections 2024-09-10T09:22:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.589+0000 7fe2456c9640 1 -- 172.21.15.12:0/2675633582 wait complete. 2024-09-10T09:22:39.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T09:22:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.705+0000 7fbf4f58f640 1 Processor -- start 2024-09-10T09:22:39.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.706+0000 7fbf4f58f640 1 -- start start 2024-09-10T09:22:39.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.706+0000 7fbf4f58f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf4813eaf0 0x7fbf480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.706+0000 7fbf4f58f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbf48072630 0x7fbf4806e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.706+0000 7fbf4f58f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf4813e820 con 0x7fbf480b3f50 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.706+0000 7fbf4f58f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbf48072aa0 con 0x7fbf4813eaf0 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.706+0000 7fbf4f58f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbf480b4330 con 0x7fbf48072630 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf4813eaf0 0x7fbf480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf4813eaf0 0x7fbf480720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36914/0 (socket says 172.21.15.12:36914) 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 -- 172.21.15.12:0/515296384 learned_addr learned my addr 172.21.15.12:0/515296384 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4db2c640 1 --2- 172.21.15.12:0/515296384 >> v2:172.21.15.100:3300/0 conn(0x7fbf48072630 0x7fbf4806e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 -- 172.21.15.12:0/515296384 >> v2:172.21.15.100:3300/0 conn(0x7fbf48072630 msgr2=0x7fbf4806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 --2- 172.21.15.12:0/515296384 >> v2:172.21.15.100:3300/0 conn(0x7fbf48072630 0x7fbf4806e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 -- 172.21.15.12:0/515296384 >> v1:172.21.15.100:6789/0 conn(0x7fbf480b3f50 legacy=0x7fbf480b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4cb2a640 1 -- 172.21.15.12:0/515296384 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf48140b20 con 0x7fbf4813eaf0 2024-09-10T09:22:39.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.707+0000 7fbf4db2c640 1 --2- 172.21.15.12:0/515296384 >> v2:172.21.15.100:3300/0 conn(0x7fbf48072630 0x7fbf4806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4cb2a640 1 --2- 172.21.15.12:0/515296384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480720f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009850 tx=0x7fbf3802c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29374c3f3627ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf3ffff640 1 -- 172.21.15.12:0/515296384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38038070 con 0x7fbf4813eaf0 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf3ffff640 1 -- 172.21.15.12:0/515296384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38004230 con 0x7fbf4813eaf0 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf3ffff640 1 -- 172.21.15.12:0/515296384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38003610 con 0x7fbf4813eaf0 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 -- 172.21.15.12:0/515296384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 msgr2=0x7fbf480720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/515296384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480720f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009850 tx=0x7fbf3802c440 comp rx=0 tx=0).stop 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 -- 172.21.15.12:0/515296384 shutdown_connections 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/515296384 >> v2:172.21.15.100:3300/0 conn(0x7fbf48072630 0x7fbf4806e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/515296384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480720f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 -- 172.21.15.12:0/515296384 >> 172.21.15.12:0/515296384 conn(0x7fbf4806ccb0 msgr2=0x7fbf4806d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 -- 172.21.15.12:0/515296384 shutdown_connections 2024-09-10T09:22:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.708+0000 7fbf4f58f640 1 -- 172.21.15.12:0/515296384 wait complete. 2024-09-10T09:22:39.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 Processor -- start 2024-09-10T09:22:39.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 -- start start 2024-09-10T09:22:39.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf48072630 0x7fbf480b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf480b3f50 0x7fbf480cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf48141390 con 0x7fbf4813eaf0 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf481410b0 con 0x7fbf48072630 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4f58f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbf48141670 con 0x7fbf480b3f50 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4db2c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4db2c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36922/0 (socket says 172.21.15.12:36922) 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4db2c640 1 -- 172.21.15.12:0/3703601058 learned_addr learned my addr 172.21.15.12:0/3703601058 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4cb2a640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf480b3f50 0x7fbf480cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.710+0000 7fbf4d32b640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf48072630 0x7fbf480b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4db2c640 1 -- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf480b3f50 msgr2=0x7fbf480cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4db2c640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf480b3f50 0x7fbf480cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4db2c640 1 -- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf48072630 msgr2=0x7fbf480b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4db2c640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf48072630 0x7fbf480b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4db2c640 1 -- 172.21.15.12:0/3703601058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf481569a0 con 0x7fbf4813eaf0 2024-09-10T09:22:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4db2c640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480cc340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000cf20 tx=0x7fbf4000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4001a070 con 0x7fbf4813eaf0 2024-09-10T09:22:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4000d840 con 0x7fbf4813eaf0 2024-09-10T09:22:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf48156c80 con 0x7fbf4813eaf0 2024-09-10T09:22:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000dc30 con 0x7fbf4813eaf0 2024-09-10T09:22:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.711+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf48157240 con 0x7fbf4813eaf0 2024-09-10T09:22:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.712+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf48141950 con 0x7fbf4813eaf0 2024-09-10T09:22:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.713+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf4001d070 con 0x7fbf4813eaf0 2024-09-10T09:22:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.713+0000 7fbf3dffb640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf2c06be30 0x7fbf2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.713+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbf4008b6f0 con 0x7fbf4813eaf0 2024-09-10T09:22:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.714+0000 7fbf4d32b640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf2c06be30 0x7fbf2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.714+0000 7fbf4d32b640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf2c06be30 0x7fbf2c06e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf44004f60 tx=0x7fbf44007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:39.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.718+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf400599c0 con 0x7fbf4813eaf0 2024-09-10T09:22:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:39.930+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbf4806f4c0 con 0x7fbf4813eaf0 2024-09-10T09:22:40.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.851+0000 7fbf3dffb640 1 -- 172.21.15.12:0/3703601058 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fbf4005dcc0 con 0x7fbf4813eaf0 2024-09-10T09:22:40.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.854+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf2c06be30 msgr2=0x7fbf2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.854+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf2c06be30 0x7fbf2c06e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf44004f60 tx=0x7fbf44007e30 comp rx=0 tx=0).stop 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.854+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 msgr2=0x7fbf480cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.854+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480cc340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000cf20 tx=0x7fbf4000a7d0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 shutdown_connections 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf2c06be30 0x7fbf2c06e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf4813eaf0 0x7fbf480cc340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf480b3f50 0x7fbf480cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 --2- 172.21.15.12:0/3703601058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf48072630 0x7fbf480b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 >> 172.21.15.12:0/3703601058 conn(0x7fbf4806ccb0 msgr2=0x7fbf481594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 shutdown_connections 2024-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.855+0000 7fbf4f58f640 1 -- 172.21.15.12:0/3703601058 wait complete. 2024-09-10T09:22:40.869 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T09:22:40.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T09:22:40.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.980+0000 7fe63372a640 1 Processor -- start 2024-09-10T09:22:40.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.980+0000 7fe63372a640 1 -- start start 2024-09-10T09:22:40.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe63372a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 0x7fe62c06bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe63372a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe62c0b7ed0 0x7fe62c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe63372a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62c0d4040 con 0x7fe62c0cb2f0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe63372a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe62c0b7a40 con 0x7fe62c0b7ed0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe63372a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c0cf750 con 0x7fe62c15e960 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe630cc5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe62c0cb2f0 0x7fe62c06c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54900/0 (socket says 172.21.15.12:54900) 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe630cc5640 1 -- 172.21.15.12:0/1372265838 learned_addr learned my addr 172.21.15.12:0/1372265838 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe6314c6640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 0x7fe62c06bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353059050 0 0) 0x7fe62c0d4040 con 0x7fe62c0cb2f0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe631cc7640 1 --2- 172.21.15.12:0/1372265838 >> v2:172.21.15.100:3300/0 conn(0x7fe62c0b7ed0 0x7fe62c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe618003520 con 0x7fe62c0cb2f0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2547941126 0 0) 0x7fe618003520 con 0x7fe62c0cb2f0 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 msgr2=0x7fe62c06bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 0x7fe62c06bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 >> v2:172.21.15.100:3300/0 conn(0x7fe62c0b7ed0 msgr2=0x7fe62c0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 --2- 172.21.15.12:0/1372265838 >> v2:172.21.15.100:3300/0 conn(0x7fe62c0b7ed0 0x7fe62c0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c0cfa30 con 0x7fe62c0cb2f0 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fe61c001670 con 0x7fe62c0cb2f0 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 >> v1:172.21.15.12:6789/0 conn(0x7fe62c0cb2f0 legacy=0x7fe62c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 0x7fe6180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe618004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe618004d40 0x7fe6180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c0b7a40 con 0x7fe618003f30 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c0cf750 con 0x7fe618004d40 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.981+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe61800b9c0 con 0x7fe62c15e960 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe630cc5640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe618004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe6314c6640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 0x7fe6180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe631cc7640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe618004d40 0x7fe6180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe630cc5640 1 -- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 msgr2=0x7fe6180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe630cc5640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c15e960 0x7fe6180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe630cc5640 1 -- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe618004d40 msgr2=0x7fe6180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe630cc5640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe618004d40 0x7fe6180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.982+0000 7fe630cc5640 1 -- 172.21.15.12:0/1372265838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe618003520 con 0x7fe618003f30 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe630cc5640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe618004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001050 tx=0x7fe618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c29f0fc5a72a618 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007d70 con 0x7fe618003f30 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe61c0058d0 con 0x7fe618003f30 2024-09-10T09:22:40.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe623fff640 1 -- 172.21.15.12:0/1372265838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c005ce0 con 0x7fe618003f30 2024-09-10T09:22:40.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe63372a640 1 -- 172.21.15.12:0/1372265838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 msgr2=0x7fe618004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe63372a640 1 --2- 172.21.15.12:0/1372265838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe618004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001050 tx=0x7fe618005830 comp rx=0 tx=0).stop 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe631cc7640 1 -- 172.21.15.12:0/1372265838 reap_dead start 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe63372a640 1 -- 172.21.15.12:0/1372265838 shutdown_connections 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe63372a640 1 -- 172.21.15.12:0/1372265838 >> 172.21.15.12:0/1372265838 conn(0x7fe62c0d46e0 msgr2=0x7fe62c0d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe63372a640 1 -- 172.21.15.12:0/1372265838 shutdown_connections 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.983+0000 7fe63372a640 1 -- 172.21.15.12:0/1372265838 wait complete. 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 Processor -- start 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 -- start start 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe62c161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c0ab1a0 0x7fe62c0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe62c0acfb0 0x7fe62c1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c06cbc0 con 0x7fe618003f30 2024-09-10T09:22:40.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c0d3cd0 con 0x7fe62c0acfb0 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe63372a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c06cd40 con 0x7fe62c0ab1a0 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe6314c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe62c161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.985+0000 7fe6314c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe62c161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36936/0 (socket says 172.21.15.12:36936) 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 -- 172.21.15.12:0/2893881808 learned_addr learned my addr 172.21.15.12:0/2893881808 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe630cc5640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c0ab1a0 0x7fe62c0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe631cc7640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe62c0acfb0 0x7fe62c1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 -- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c0ab1a0 msgr2=0x7fe62c0aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c0ab1a0 0x7fe62c0aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 -- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe62c0acfb0 msgr2=0x7fe62c1f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe62c0acfb0 0x7fe62c1f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 -- 172.21.15.12:0/2893881808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c0ab9d0 con 0x7fe618003f30 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe631cc7640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe62c0acfb0 0x7fe62c1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:40.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe6314c6640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe62c161150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe628011e30 tx=0x7fe62800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628015630 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6280157d0 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628015ba0 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c0abcb0 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.986+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c0ac270 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.987+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c0d4040 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.988+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe62801d400 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.988+0000 7fe621ffb640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe61006be30 0x7fe61006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.988+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe62808bf90 con 0x7fe618003f30 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.989+0000 7fe630cc5640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe61006be30 0x7fe61006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:40.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.989+0000 7fe630cc5640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe61006be30 0x7fe61006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe61c033000 tx=0x7fe61c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:40.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:40.993+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe628019030 con 0x7fe618003f30 2024-09-10T09:22:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.206+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe62c0cf280 con 0x7fe618003f30 2024-09-10T09:22:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.948+0000 7fe621ffb640 1 -- 172.21.15.12:0/2893881808 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fe628010040 con 0x7fe618003f30 2024-09-10T09:22:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe61006be30 msgr2=0x7fe61006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe61006be30 0x7fe61006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe61c033000 tx=0x7fe61c009030 comp rx=0 tx=0).stop 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 msgr2=0x7fe62c161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe62c161150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe628011e30 tx=0x7fe62800f580 comp rx=0 tx=0).stop 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 shutdown_connections 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe61006be30 0x7fe61006e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe62c0acfb0 0x7fe62c1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe62c0ab1a0 0x7fe62c0aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 --2- 172.21.15.12:0/2893881808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe618003f30 0x7fe62c161150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 >> 172.21.15.12:0/2893881808 conn(0x7fe62c0d46e0 msgr2=0x7fe62c06bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 shutdown_connections 2024-09-10T09:22:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:41.951+0000 7fe63372a640 1 -- 172.21.15.12:0/2893881808 wait complete. 2024-09-10T09:22:41.966 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T09:22:41.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:22:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.074+0000 7f054ffff640 1 Processor -- start 2024-09-10T09:22:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.074+0000 7f054ffff640 1 -- start start 2024-09-10T09:22:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f05500d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05500b66e0 0x7f05500b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054ffff640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055006bee0 con 0x7f05500d3f60 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054ffff640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f055015ea20 con 0x7f05500b66e0 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054ffff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f055006caf0 con 0x7f055015e640 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054f7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05500b66e0 0x7f05500b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054effd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f05500d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054f7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05500b66e0 0x7f05500b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:56878/0 (socket says 172.21.15.12:56878) 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054effd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f05500d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:53930/0 (socket says 172.21.15.12:53930) 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054e7fc640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f05500d3f60 0x7f05500b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:48230/0 (socket says 172.21.15.12:48230) 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.075+0000 7f054f7fe640 1 -- 172.21.15.12:0/2293114264 learned_addr learned my addr 172.21.15.12:0/2293114264 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054f7fe640 1 -- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 msgr2=0x7f05500d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054f7fe640 1 --2- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f05500d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054f7fe640 1 -- 172.21.15.12:0/2293114264 >> v1:172.21.15.100:6789/0 conn(0x7f05500d3f60 legacy=0x7f05500b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054f7fe640 1 -- 172.21.15.12:0/2293114264 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055006c1c0 con 0x7f05500b66e0 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054dffb640 1 -- 172.21.15.12:0/2293114264 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035866581 0 0) 0x7f055006bee0 con 0x7f05500d3f60 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054effd640 1 --2- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f05500d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.076+0000 7f054f7fe640 1 --2- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f05500b7750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0548009e50 tx=0x7f054802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7b6924287a21ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054dffb640 1 -- 172.21.15.12:0/2293114264 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548036070 con 0x7f05500b66e0 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054dffb640 1 -- 172.21.15.12:0/2293114264 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548031600 con 0x7f05500b66e0 2024-09-10T09:22:42.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054dffb640 1 -- 172.21.15.12:0/2293114264 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480319d0 con 0x7f05500b66e0 2024-09-10T09:22:42.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 -- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 msgr2=0x7f05500b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 --2- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f05500b7750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0548009e50 tx=0x7f054802a710 comp rx=0 tx=0).stop 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 -- 172.21.15.12:0/2293114264 shutdown_connections 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 --2- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f05500b7750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 --2- 172.21.15.12:0/2293114264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f05500d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 -- 172.21.15.12:0/2293114264 >> 172.21.15.12:0/2293114264 conn(0x7f05500d0fd0 msgr2=0x7f05500d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 -- 172.21.15.12:0/2293114264 shutdown_connections 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.077+0000 7f054ffff640 1 -- 172.21.15.12:0/2293114264 wait complete. 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 Processor -- start 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 -- start start 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f055015f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 0x7f05501e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f0550150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05500b7c90 con 0x7f05500d3f60 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f055006c780 con 0x7f05500b66e0 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.079+0000 7f054ffff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f05500b7e10 con 0x7f055015e640 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 0x7f05501e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 0x7f05501e6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36948/0 (socket says 172.21.15.12:36948) 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 -- 172.21.15.12:0/3797901805 learned_addr learned my addr 172.21.15.12:0/3797901805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054effd640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f055015f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054f7fe640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f0550150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 -- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 msgr2=0x7f0550150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f0550150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 -- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 msgr2=0x7f055015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f055015f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 -- 172.21.15.12:0/3797901805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05501e7550 con 0x7f05500d3f60 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054effd640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f055015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054e7fc640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 0x7f05501e6b00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f054400c4b0 tx=0x7f054400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544018070 con 0x7f05500d3f60 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0544007500 con 0x7f05500d3f60 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544004a20 con 0x7f05500d3f60 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05501e7830 con 0x7f05500d3f60 2024-09-10T09:22:42.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.080+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05501e80d0 con 0x7f05500d3f60 2024-09-10T09:22:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.081+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05500b7750 con 0x7f05500d3f60 2024-09-10T09:22:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.082+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f054401b070 con 0x7f05500d3f60 2024-09-10T09:22:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.082+0000 7f05377fe640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f053c06be30 0x7f053c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.082+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f054408a130 con 0x7f05500d3f60 2024-09-10T09:22:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.083+0000 7f054effd640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f053c06be30 0x7f053c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.083+0000 7f054effd640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f053c06be30 0x7f053c06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0540009560 tx=0x7f0540009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.087+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0544058550 con 0x7f05500d3f60 2024-09-10T09:22:42.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.302+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05500d0980 con 0x7f05500d3f60 2024-09-10T09:22:42.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.303+0000 7f05377fe640 1 -- 172.21.15.12:0/3797901805 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f054405c850 con 0x7f05500d3f60 2024-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f053c06be30 msgr2=0x7f053c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f053c06be30 0x7f053c06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0540009560 tx=0x7f0540009190 comp rx=0 tx=0).stop 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 msgr2=0x7f05501e6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 0x7f05501e6b00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f054400c4b0 tx=0x7f054400c970 comp rx=0 tx=0).stop 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 shutdown_connections 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f053c06be30 0x7f053c06e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f055015e640 0x7f0550150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05500d3f60 0x7f05501e6b00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 --2- 172.21.15.12:0/3797901805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05500b66e0 0x7f055015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 >> 172.21.15.12:0/3797901805 conn(0x7f05500d0fd0 msgr2=0x7f055015ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:42.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 shutdown_connections 2024-09-10T09:22:42.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.305+0000 7f054ffff640 1 -- 172.21.15.12:0/3797901805 wait complete. 2024-09-10T09:22:42.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:42.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.419+0000 7f91c0386640 1 Processor -- start 2024-09-10T09:22:42.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.419+0000 7f91c0386640 1 -- start start 2024-09-10T09:22:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91c0386640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91b815e940 0x7f91b80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91c0386640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b80b7170 con 0x7f91b815ed20 2024-09-10T09:22:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91c0386640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b80b7aa0 con 0x7f91b80cef90 2024-09-10T09:22:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91c0386640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f91b80d3660 con 0x7f91b815e940 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd921640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f91b815ed20 0x7f91b80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54908/0 (socket says 172.21.15.12:54908) 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd921640 1 -- 172.21.15.12:0/3814240054 learned_addr learned my addr 172.21.15.12:0/3814240054 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91be122640 1 --2- 172.21.15.12:0/3814240054 >> v2:172.21.15.100:3300/0 conn(0x7f91b815e940 0x7f91b80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10377847 0 0) 0x7f91a8001110 con 0x7f91b815ed20 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a4003520 con 0x7f91b815ed20 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1581404009 0 0) 0x7f91a4003520 con 0x7f91b815ed20 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 >> v2:172.21.15.100:3300/0 conn(0x7f91b815e940 msgr2=0x7f91b80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 --2- 172.21.15.12:0/3814240054 >> v2:172.21.15.100:3300/0 conn(0x7f91b815e940 0x7f91b80d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 >> v1:172.21.15.100:6789/0 conn(0x7f91b80cef90 legacy=0x7f91b80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80d3940 con 0x7f91b815ed20 2024-09-10T09:22:42.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f91a8001840 con 0x7f91b815ed20 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 >> v1:172.21.15.12:6789/0 conn(0x7f91b815ed20 legacy=0x7f91b80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a40039b0 0x7f91a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4004800 0x7f91a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40051c0 0x7f91a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80d3660 con 0x7f91a40039b0 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91a400c070 con 0x7f91a4004800 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f91a400c270 con 0x7f91a40051c0 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.420+0000 7f91be122640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a40039b0 0x7f91a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91bd921640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4004800 0x7f91a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be923640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40051c0 0x7f91a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be122640 1 -- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40051c0 msgr2=0x7f91a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be122640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40051c0 0x7f91a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be122640 1 -- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4004800 msgr2=0x7f91a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:42.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be122640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4004800 0x7f91a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be122640 1 -- 172.21.15.12:0/3814240054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a4003520 con 0x7f91a40039b0 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91bd921640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4004800 0x7f91a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be923640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40051c0 0x7f91a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be923640 1 -- 172.21.15.12:0/3814240054 reap_dead start 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.421+0000 7f91be122640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a40039b0 0x7f91a4003dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009ac0 tx=0x7f91a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7d07554ae74d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b4036070 con 0x7f91a40039b0 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b4031400 con 0x7f91a40039b0 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91bd120640 1 -- 172.21.15.12:0/3814240054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b4009690 con 0x7f91a40039b0 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 -- 172.21.15.12:0/3814240054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a40039b0 msgr2=0x7f91a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a40039b0 0x7f91a4003dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009ac0 tx=0x7f91a4005830 comp rx=0 tx=0).stop 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 -- 172.21.15.12:0/3814240054 shutdown_connections 2024-09-10T09:22:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 --2- 172.21.15.12:0/3814240054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a40039b0 0x7f91a4003dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 -- 172.21.15.12:0/3814240054 >> 172.21.15.12:0/3814240054 conn(0x7f91b80b6240 msgr2=0x7f91b80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 -- 172.21.15.12:0/3814240054 shutdown_connections 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.422+0000 7f91c0386640 1 -- 172.21.15.12:0/3814240054 wait complete. 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.423+0000 7f91c0386640 1 Processor -- start 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 -- start start 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40039b0 0x7f91b8154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 0x7f91b80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b81e9a80 0x7f91b815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80d1ef0 con 0x7f91b80cde10 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80d3f00 con 0x7f91b81e9a80 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91c0386640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f91b80d2070 con 0x7f91a40039b0 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91bd921640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 0x7f91b80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91bd921640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 0x7f91b80cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36968/0 (socket says 172.21.15.12:36968) 2024-09-10T09:22:42.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.424+0000 7f91bd921640 1 -- 172.21.15.12:0/4100511906 learned_addr learned my addr 172.21.15.12:0/4100511906 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91be122640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40039b0 0x7f91b8154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91be923640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b81e9a80 0x7f91b815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91bd921640 1 -- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40039b0 msgr2=0x7f91b8154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91bd921640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40039b0 0x7f91b8154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91bd921640 1 -- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b81e9a80 msgr2=0x7f91b815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91bd921640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b81e9a80 0x7f91b815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91bd921640 1 -- 172.21.15.12:0/4100511906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b8155180 con 0x7f91b80cde10 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91bd921640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 0x7f91b80cc440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91a8007330 tx=0x7f91a80077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a800ea10 con 0x7f91b80cde10 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8018070 con 0x7f91b80cde10 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b80cc980 con 0x7f91b80cde10 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a800edb0 con 0x7f91b80cde10 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.425+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b80ce8d0 con 0x7f91b80cde10 2024-09-10T09:22:42.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.426+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b80cead0 con 0x7f91b80cde10 2024-09-10T09:22:42.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.427+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91a801d460 con 0x7f91b80cde10 2024-09-10T09:22:42.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.427+0000 7f91aeffd640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f919c06be60 0x7f919c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.427+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91a808ae70 con 0x7f91b80cde10 2024-09-10T09:22:42.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.428+0000 7f91be122640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f919c06be60 0x7f919c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.428+0000 7f91be122640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f919c06be60 0x7f919c06e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f91b4033000 tx=0x7f91b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.432+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91b80cead0 con 0x7f91b80cde10 2024-09-10T09:22:42.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.608+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91b80d1060 con 0x7f91b80cde10 2024-09-10T09:22:42.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.609+0000 7f91aeffd640 1 -- 172.21.15.12:0/4100511906 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f91b8155180 con 0x7f91b80cde10 2024-09-10T09:22:42.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:42.611 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f919c06be60 msgr2=0x7f919c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f919c06be60 0x7f919c06e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f91b4033000 tx=0x7f91b4008030 comp rx=0 tx=0).stop 2024-09-10T09:22:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 msgr2=0x7f91b80cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 0x7f91b80cc440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91a8007330 tx=0x7f91a80077f0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 shutdown_connections 2024-09-10T09:22:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f919c06be60 0x7f919c06e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b81e9a80 0x7f91b815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91b80cde10 0x7f91b80cc440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 --2- 172.21.15.12:0/4100511906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91a40039b0 0x7f91b8154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 >> 172.21.15.12:0/4100511906 conn(0x7f91b80b6240 msgr2=0x7f91b80b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 shutdown_connections 2024-09-10T09:22:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.611+0000 7f91c0386640 1 -- 172.21.15.12:0/4100511906 wait complete. 2024-09-10T09:22:42.626 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T09:22:42.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:22:42.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.727+0000 7f1393b49640 1 Processor -- start 2024-09-10T09:22:42.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.727+0000 7f1393b49640 1 -- start start 2024-09-10T09:22:42.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f1393b49640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f138c15eac0 0x7f138c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f1393b49640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f138c0b68d0 0x7f138c0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f1393b49640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f138c0d26f0 con 0x7f138c0ced90 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f1393b49640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f138c0d29d0 con 0x7f138c15eac0 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f1393b49640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f138c0d2cb0 con 0x7f138c0b68d0 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f13918e5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f138c15eac0 0x7f138c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f13918e5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f138c15eac0 0x7f138c0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45700/0 (socket says 172.21.15.12:45700) 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f13918e5640 1 -- 172.21.15.12:0/1099198429 learned_addr learned my addr 172.21.15.12:0/1099198429 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f13920e6640 1 --2- 172.21.15.12:0/1099198429 >> v2:172.21.15.100:3300/0 conn(0x7f138c0b68d0 0x7f138c0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f13918e5640 1 -- 172.21.15.12:0/1099198429 >> v2:172.21.15.100:3300/0 conn(0x7f138c0b68d0 msgr2=0x7f138c0b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.728+0000 7f13918e5640 1 --2- 172.21.15.12:0/1099198429 >> v2:172.21.15.100:3300/0 conn(0x7f138c0b68d0 0x7f138c0b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.729+0000 7f13918e5640 1 -- 172.21.15.12:0/1099198429 >> v1:172.21.15.100:6789/0 conn(0x7f138c0ced90 legacy=0x7f138c0b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.729+0000 7f13918e5640 1 -- 172.21.15.12:0/1099198429 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c0d2f90 con 0x7f138c15eac0 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.729+0000 7f13918e5640 1 --2- 172.21.15.12:0/1099198429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0cfc80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f138c069f80 tx=0x7f138802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d5036a3e5590ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.729+0000 7f13908e3640 1 -- 172.21.15.12:0/1099198429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388037070 con 0x7f138c15eac0 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.729+0000 7f13908e3640 1 -- 172.21.15.12:0/1099198429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388032440 con 0x7f138c15eac0 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.729+0000 7f13908e3640 1 -- 172.21.15.12:0/1099198429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388032810 con 0x7f138c15eac0 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 -- 172.21.15.12:0/1099198429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 msgr2=0x7f138c0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 --2- 172.21.15.12:0/1099198429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0cfc80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f138c069f80 tx=0x7f138802a270 comp rx=0 tx=0).stop 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 -- 172.21.15.12:0/1099198429 shutdown_connections 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 --2- 172.21.15.12:0/1099198429 >> v2:172.21.15.100:3300/0 conn(0x7f138c0b68d0 0x7f138c0b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 --2- 172.21.15.12:0/1099198429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0cfc80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 -- 172.21.15.12:0/1099198429 >> 172.21.15.12:0/1099198429 conn(0x7f138c0d11c0 msgr2=0x7f138c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 -- 172.21.15.12:0/1099198429 shutdown_connections 2024-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.730+0000 7f1393b49640 1 -- 172.21.15.12:0/1099198429 wait complete. 2024-09-10T09:22:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.731+0000 7f1393b49640 1 Processor -- start 2024-09-10T09:22:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.731+0000 7f1393b49640 1 -- start start 2024-09-10T09:22:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f1393b49640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f138c0b68d0 0x7f138c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f1393b49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f138c0ced90 0x7f138c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f1393b49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f1393b49640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0d2490 con 0x7f138c15eac0 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f1393b49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0d2310 con 0x7f138c0ced90 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f1393b49640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f138c0d3790 con 0x7f138c0b68d0 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45714/0 (socket says 172.21.15.12:45714) 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 -- 172.21.15.12:0/2000390571 learned_addr learned my addr 172.21.15.12:0/2000390571 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13918e5640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f138c0b68d0 0x7f138c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13910e4640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f138c0ced90 0x7f138c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 -- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f138c0b68d0 msgr2=0x7f138c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f138c0b68d0 0x7f138c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 -- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f138c0ced90 msgr2=0x7f138c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f138c0ced90 0x7f138c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.732+0000 7f13920e6640 1 -- 172.21.15.12:0/2000390571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c15a590 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.733+0000 7f13920e6640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0c8250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f138400efc0 tx=0x7f138400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.733+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384018020 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.733+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1384014480 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.733+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384014870 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.733+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c15a870 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.733+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c15a1c0 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.734+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c0cfc80 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.734+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1384005d10 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.735+0000 7f13827fc640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f137006be30 0x7f137006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.735+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f138408bbe0 con 0x7f138c15eac0 2024-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.735+0000 7f13918e5640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f137006be30 0x7f137006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.736+0000 7f13918e5640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f137006be30 0x7f137006e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1388034000 tx=0x7f138802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.739+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1384022030 con 0x7f138c15eac0 2024-09-10T09:22:42.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.913+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f138c0ba450 con 0x7f137006be30 2024-09-10T09:22:42.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.920+0000 7f13827fc640 1 -- 172.21.15.12:0/2000390571 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240067 (secure 0 0 0) 0x7f138c0ba450 con 0x7f137006be30 2024-09-10T09:22:42.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:42.925 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f137006be30 msgr2=0x7f137006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f137006be30 0x7f137006e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1388034000 tx=0x7f138802e000 comp rx=0 tx=0).stop 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 msgr2=0x7f138c0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0c8250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f138400efc0 tx=0x7f138400c490 comp rx=0 tx=0).stop 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 shutdown_connections 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f137006be30 0x7f137006e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138c15eac0 0x7f138c0c8250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f138c0ced90 0x7f138c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 --2- 172.21.15.12:0/2000390571 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f138c0b68d0 0x7f138c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 >> 172.21.15.12:0/2000390571 conn(0x7f138c0d11c0 msgr2=0x7f138c0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:42.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.923+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 shutdown_connections 2024-09-10T09:22:42.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:42.924+0000 7f1393b49640 1 -- 172.21.15.12:0/2000390571 wait complete. 2024-09-10T09:22:42.936 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T09:22:41.222002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":2476,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":2535424,"data_stored":1589563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.307891"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.918103+0000","last_change":"2024-09-10T09:22:36.918103+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.918103+0000","last_undegraded":"2024-09-10T09:22:36.918103+0000","last_fullsized":"2024-09-10T09:22:36.918103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.924917+0000","last_change":"2024-09-10T09:22:36.924917+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.924917+0000","last_undegraded":"2024-09-10T09:22:36.924917+0000","last_fullsized":"2024-09-10T09:22:36.924917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.918009+0000","last_change":"2024-09-10T09:22:36.918009+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.918009+0000","last_undegraded":"2024-09-10T09:22:36.918009+0000","last_fullsized":"2024-09-10T09:22:36.918009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.918788+0000","last_change":"2024-09-10T09:22:36.918788+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.918788+0000","last_undegraded":"2024-09-10T09:22:36.918788+0000","last_fullsized":"2024-09-10T09:22:36.918788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.925568+0000","last_change":"2024-09-10T09:22:36.925568+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.925568+0000","last_undegraded":"2024-09-10T09:22:36.925568+0000","last_fullsized":"2024-09-10T09:22:36.925568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.918690+0000","last_change":"2024-09-10T09:22:36.918690+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.918690+0000","last_undegraded":"2024-09-10T09:22:36.918690+0000","last_fullsized":"2024-09-10T09:22:36.918690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.920231+0000","last_change":"2024-09-10T09:22:36.920231+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.920231+0000","last_undegraded":"2024-09-10T09:22:36.920231+0000","last_fullsized":"2024-09-10T09:22:36.920231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.924384+0000","last_change":"2024-09-10T09:22:36.924384+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.924384+0000","last_undegraded":"2024-09-10T09:22:36.924384+0000","last_fullsized":"2024-09-10T09:22:36.924384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919543+0000","last_change":"2024-09-10T09:22:36.919543+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919543+0000","last_undegraded":"2024-09-10T09:22:36.919543+0000","last_fullsized":"2024-09-10T09:22:36.919543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919556+0000","last_change":"2024-09-10T09:22:36.919556+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919556+0000","last_undegraded":"2024-09-10T09:22:36.919556+0000","last_fullsized":"2024-09-10T09:22:36.919556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.924780+0000","last_change":"2024-09-10T09:22:36.924780+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.924780+0000","last_undegraded":"2024-09-10T09:22:36.924780+0000","last_fullsized":"2024-09-10T09:22:36.924780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.922091+0000","last_change":"2024-09-10T09:22:36.922091+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.922091+0000","last_undegraded":"2024-09-10T09:22:36.922091+0000","last_fullsized":"2024-09-10T09:22:36.922091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.916110+0000","last_change":"2024-09-10T09:22:36.916110+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.916110+0000","last_undegraded":"2024-09-10T09:22:36.916110+0000","last_fullsized":"2024-09-10T09:22:36.916110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.922124+0000","last_change":"2024-09-10T09:22:36.922124+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.922124+0000","last_undegraded":"2024-09-10T09:22:36.922124+0000","last_fullsized":"2024-09-10T09:22:36.922124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919623+0000","last_change":"2024-09-10T09:22:36.919623+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919623+0000","last_undegraded":"2024-09-10T09:22:36.919623+0000","last_fullsized":"2024-09-10T09:22:36.919623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.922417+0000","last_change":"2024-09-10T09:22:36.922417+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.922417+0000","last_undegraded":"2024-09-10T09:22:36.922417+0000","last_fullsized":"2024-09-10T09:22:36.922417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T09:22:36.917530+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:22:36.917530+0000","last_peered":"2024-09-10T09:22:36.917530+0000","last_clean":"2024-09-10T09:22:36.917530+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:22:36.917530+0000","last_undegraded":"2024-09-10T09:22:36.917530+0000","last_fullsized":"2024-09-10T09:22:36.917530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.918712+0000","last_change":"2024-09-10T09:22:36.918712+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.918712+0000","last_undegraded":"2024-09-10T09:22:36.918712+0000","last_fullsized":"2024-09-10T09:22:36.918712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.916136+0000","last_change":"2024-09-10T09:22:36.916136+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.916136+0000","last_undegraded":"2024-09-10T09:22:36.916136+0000","last_fullsized":"2024-09-10T09:22:36.916136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.922235+0000","last_change":"2024-09-10T09:22:36.922235+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.922235+0000","last_undegraded":"2024-09-10T09:22:36.922235+0000","last_fullsized":"2024-09-10T09:22:36.922235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919051+0000","last_change":"2024-09-10T09:22:36.919051+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919051+0000","last_undegraded":"2024-09-10T09:22:36.919051+0000","last_fullsized":"2024-09-10T09:22:36.919051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919156+0000","last_change":"2024-09-10T09:22:36.919156+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919156+0000","last_undegraded":"2024-09-10T09:22:36.919156+0000","last_fullsized":"2024-09-10T09:22:36.919156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.917151+0000","last_change":"2024-09-10T09:22:36.917151+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.917151+0000","last_undegraded":"2024-09-10T09:22:36.917151+0000","last_fullsized":"2024-09-10T09:22:36.917151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.921076+0000","last_change":"2024-09-10T09:22:36.921076+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.921076+0000","last_undegraded":"2024-09-10T09:22:36.921076+0000","last_fullsized":"2024-09-10T09:22:36.921076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.924558+0000","last_change":"2024-09-10T09:22:36.924558+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.924558+0000","last_undegraded":"2024-09-10T09:22:36.924558+0000","last_fullsized":"2024-09-10T09:22:36.924558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.916768+0000","last_change":"2024-09-10T09:22:36.916768+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.916768+0000","last_undegraded":"2024-09-10T09:22:36.916768+0000","last_fullsized":"2024-09-10T09:22:36.916768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919349+0000","last_change":"2024-09-10T09:22:36.919349+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919349+0000","last_undegraded":"2024-09-10T09:22:36.919349+0000","last_fullsized":"2024-09-10T09:22:36.919349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.919288+0000","last_change":"2024-09-10T09:22:36.919288+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.919288+0000","last_undegraded":"2024-09-10T09:22:36.919288+0000","last_fullsized":"2024-09-10T09:22:36.919288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.916173+0000","last_change":"2024-09-10T09:22:36.916173+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.916173+0000","last_undegraded":"2024-09-10T09:22:36.916173+0000","last_fullsized":"2024-09-10T09:22:36.916173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.916138+0000","last_change":"2024-09-10T09:22:36.916138+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.916138+0000","last_undegraded":"2024-09-10T09:22:36.916138+0000","last_fullsized":"2024-09-10T09:22:36.916138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.917758+0000","last_change":"2024-09-10T09:22:36.917758+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.917758+0000","last_undegraded":"2024-09-10T09:22:36.917758+0000","last_fullsized":"2024-09-10T09:22:36.917758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.918180+0000","last_change":"2024-09-10T09:22:36.918180+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.918180+0000","last_undegraded":"2024-09-10T09:22:36.918180+0000","last_fullsized":"2024-09-10T09:22:36.918180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:22:37.913422+0000","last_change":"2024-09-10T09:22:37.913422+0000","last_active":"2024-09-10T09:22:37.913422+0000","last_peered":"2024-09-10T09:22:37.913422+0000","last_clean":"2024-09-10T09:22:37.913422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:37.913422+0000","last_undegraded":"2024-09-10T09:22:37.913422+0000","last_fullsized":"2024-09-10T09:22:37.913422+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T09:22:36.920926+0000","last_change":"2024-09-10T09:22:36.920926+0000","last_active":"2024-09-10T09:22:36.911070+0000","last_peered":"2024-09-10T09:22:36.911070+0000","last_clean":"2024-09-10T09:22:36.911070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:22:36.920926+0000","last_undegraded":"2024-09-10T09:22:36.920926+0000","last_fullsized":"2024-09-10T09:22:36.920926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":645107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":48922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":48922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":54739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":48922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":48922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":54739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":757760,"data_stored":639290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:22:42.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:22:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.077+0000 7f0adc0e6640 1 Processor -- start 2024-09-10T09:22:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.077+0000 7f0adc0e6640 1 -- start start 2024-09-10T09:22:43.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0adc0e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ad415e940 0x7f0ad40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0adc0e6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415ed20 0x7f0ad40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0adc0e6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad40b7170 con 0x7f0ad40cef90 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0adc0e6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad40d1ae0 con 0x7f0ad415e940 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0adc0e6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad40b7aa0 con 0x7f0ad415ed20 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad9e82640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ad415e940 0x7f0ad40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ada683640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0ad40cef90 0x7f0ad40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51556/0 (socket says 172.21.15.12:51556) 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ada683640 1 -- 172.21.15.12:0/1629830698 learned_addr learned my addr 172.21.15.12:0/1629830698 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad9681640 1 --2- 172.21.15.12:0/1629830698 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415ed20 0x7f0ad40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad9e82640 1 -- 172.21.15.12:0/1629830698 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415ed20 msgr2=0x7f0ad40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad9e82640 1 --2- 172.21.15.12:0/1629830698 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415ed20 0x7f0ad40d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad9e82640 1 -- 172.21.15.12:0/1629830698 >> v1:172.21.15.12:6789/0 conn(0x7f0ad40cef90 legacy=0x7f0ad40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad8e80640 1 -- 172.21.15.12:0/1629830698 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359326975 0 0) 0x7f0acc001490 con 0x7f0ad40cef90 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.078+0000 7f0ad9e82640 1 -- 172.21.15.12:0/1629830698 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad40d3660 con 0x7f0ad415e940 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.079+0000 7f0ad9e82640 1 --2- 172.21.15.12:0/1629830698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad415e940 0x7f0ad40d1060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00097a0 tx=0x7f0ad002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5f7d5244bce929 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.079+0000 7f0ad8e80640 1 -- 172.21.15.12:0/1629830698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0037070 con 0x7f0ad415e940 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.079+0000 7f0ad8e80640 1 -- 172.21.15.12:0/1629830698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad0032440 con 0x7f0ad415e940 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.079+0000 7f0ad8e80640 1 -- 172.21.15.12:0/1629830698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0032810 con 0x7f0ad415e940 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 -- 172.21.15.12:0/1629830698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad415e940 msgr2=0x7f0ad40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/1629830698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad415e940 0x7f0ad40d1060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00097a0 tx=0x7f0ad002a210 comp rx=0 tx=0).stop 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 -- 172.21.15.12:0/1629830698 shutdown_connections 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/1629830698 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415ed20 0x7f0ad40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/1629830698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad415e940 0x7f0ad40d1060 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 -- 172.21.15.12:0/1629830698 >> 172.21.15.12:0/1629830698 conn(0x7f0ad40b6240 msgr2=0x7f0ad40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 -- 172.21.15.12:0/1629830698 shutdown_connections 2024-09-10T09:22:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.080+0000 7f0adc0e6640 1 -- 172.21.15.12:0/1629830698 wait complete. 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.081+0000 7f0adc0e6640 1 Processor -- start 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.081+0000 7f0adc0e6640 1 -- start start 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 0x7f0ad4156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415e940 0x7f0ad415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad415ed20 0x7f0ad41f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40d3f00 con 0x7f0ad40cef90 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40d3c20 con 0x7f0ad415ed20 2024-09-10T09:22:43.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad40d3310 con 0x7f0ad415e940 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 0x7f0ad4156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 0x7f0ad4156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45740/0 (socket says 172.21.15.12:45740) 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 -- 172.21.15.12:0/2522080513 learned_addr learned my addr 172.21.15.12:0/2522080513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 -- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415e940 msgr2=0x7f0ad415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415e940 0x7f0ad415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 -- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad415ed20 msgr2=0x7f0ad41f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad415ed20 0x7f0ad41f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 -- 172.21.15.12:0/2522080513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4159ac0 con 0x7f0ad40cef90 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0ad9e82640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 0x7f0ad4156ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0035040 tx=0x7f0ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0037050 con 0x7f0ad40cef90 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad0038040 con 0x7f0ad40cef90 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad4159da0 con 0x7f0ad40cef90 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0004470 con 0x7f0ad40cef90 2024-09-10T09:22:43.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad415a360 con 0x7f0ad40cef90 2024-09-10T09:22:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.083+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad406d470 con 0x7f0ad40cef90 2024-09-10T09:22:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.084+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ad0030900 con 0x7f0ad40cef90 2024-09-10T09:22:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.085+0000 7f0aca7fc640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0ab806be30 0x7f0ab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.085+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad00ab960 con 0x7f0ad40cef90 2024-09-10T09:22:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.085+0000 7f0ad9681640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0ab806be30 0x7f0ab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.085+0000 7f0ad9681640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0ab806be30 0x7f0ab806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ad415aa90 tx=0x7f0ac4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.090+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ad406d470 con 0x7f0ad40cef90 2024-09-10T09:22:43.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.262+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ad40d1ef0 con 0x7f0ab806be30 2024-09-10T09:22:43.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.269+0000 7f0aca7fc640 1 -- 172.21.15.12:0/2522080513 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f0ad40d1ef0 con 0x7f0ab806be30 2024-09-10T09:22:43.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0ab806be30 msgr2=0x7f0ab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0ab806be30 0x7f0ab806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ad415aa90 tx=0x7f0ac4008040 comp rx=0 tx=0).stop 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 msgr2=0x7f0ad4156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 0x7f0ad4156ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0035040 tx=0x7f0ad00046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 shutdown_connections 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0ab806be30 0x7f0ab806e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad415ed20 0x7f0ad41f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ad415e940 0x7f0ad415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 --2- 172.21.15.12:0/2522080513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad40cef90 0x7f0ad4156ff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 >> 172.21.15.12:0/2522080513 conn(0x7f0ad40b6240 msgr2=0x7f0ad40b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:43.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 shutdown_connections 2024-09-10T09:22:43.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.272+0000 7f0adc0e6640 1 -- 172.21.15.12:0/2522080513 wait complete. 2024-09-10T09:22:43.284 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T09:22:43.222431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":2957312,"data_stored":1778268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001190"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394392+0000","last_change":"2024-09-10T09:22:38.976004+0000","last_active":"2024-09-10T09:22:40.394392+0000","last_peered":"2024-09-10T09:22:40.394392+0000","last_clean":"2024-09-10T09:22:40.394392+0000","last_became_active":"2024-09-10T09:22:38.975474+0000","last_became_peered":"2024-09-10T09:22:38.975474+0000","last_unstale":"2024-09-10T09:22:40.394392+0000","last_undegraded":"2024-09-10T09:22:40.394392+0000","last_fullsized":"2024-09-10T09:22:40.394392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:24.977108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956394+0000","last_change":"2024-09-10T09:22:38.956552+0000","last_active":"2024-09-10T09:22:39.956394+0000","last_peered":"2024-09-10T09:22:39.956394+0000","last_clean":"2024-09-10T09:22:39.956394+0000","last_became_active":"2024-09-10T09:22:38.956278+0000","last_became_peered":"2024-09-10T09:22:38.956278+0000","last_unstale":"2024-09-10T09:22:39.956394+0000","last_undegraded":"2024-09-10T09:22:39.956394+0000","last_fullsized":"2024-09-10T09:22:39.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:03.584901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766351+0000","last_change":"2024-09-10T09:22:38.949199+0000","last_active":"2024-09-10T09:22:40.766351+0000","last_peered":"2024-09-10T09:22:40.766351+0000","last_clean":"2024-09-10T09:22:40.766351+0000","last_became_active":"2024-09-10T09:22:38.948874+0000","last_became_peered":"2024-09-10T09:22:38.948874+0000","last_unstale":"2024-09-10T09:22:40.766351+0000","last_undegraded":"2024-09-10T09:22:40.766351+0000","last_fullsized":"2024-09-10T09:22:40.766351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:52.643340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959878+0000","last_change":"2024-09-10T09:22:38.959631+0000","last_active":"2024-09-10T09:22:39.959878+0000","last_peered":"2024-09-10T09:22:39.959878+0000","last_clean":"2024-09-10T09:22:39.959878+0000","last_became_active":"2024-09-10T09:22:38.959224+0000","last_became_peered":"2024-09-10T09:22:38.959224+0000","last_unstale":"2024-09-10T09:22:39.959878+0000","last_undegraded":"2024-09-10T09:22:39.959878+0000","last_fullsized":"2024-09-10T09:22:39.959878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:09.259685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394013+0000","last_change":"2024-09-10T09:22:38.961515+0000","last_active":"2024-09-10T09:22:40.394013+0000","last_peered":"2024-09-10T09:22:40.394013+0000","last_clean":"2024-09-10T09:22:40.394013+0000","last_became_active":"2024-09-10T09:22:38.961173+0000","last_became_peered":"2024-09-10T09:22:38.961173+0000","last_unstale":"2024-09-10T09:22:40.394013+0000","last_undegraded":"2024-09-10T09:22:40.394013+0000","last_fullsized":"2024-09-10T09:22:40.394013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:08.149787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960116+0000","last_change":"2024-09-10T09:22:38.956333+0000","last_active":"2024-09-10T09:22:39.960116+0000","last_peered":"2024-09-10T09:22:39.960116+0000","last_clean":"2024-09-10T09:22:39.960116+0000","last_became_active":"2024-09-10T09:22:38.956056+0000","last_became_peered":"2024-09-10T09:22:38.956056+0000","last_unstale":"2024-09-10T09:22:39.960116+0000","last_undegraded":"2024-09-10T09:22:39.960116+0000","last_fullsized":"2024-09-10T09:22:39.960116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393891+0000","last_change":"2024-09-10T09:22:38.969810+0000","last_active":"2024-09-10T09:22:40.393891+0000","last_peered":"2024-09-10T09:22:40.393891+0000","last_clean":"2024-09-10T09:22:40.393891+0000","last_became_active":"2024-09-10T09:22:38.969545+0000","last_became_peered":"2024-09-10T09:22:38.969545+0000","last_unstale":"2024-09-10T09:22:40.393891+0000","last_undegraded":"2024-09-10T09:22:40.393891+0000","last_fullsized":"2024-09-10T09:22:40.393891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:26.724466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765114+0000","last_change":"2024-09-10T09:22:38.961518+0000","last_active":"2024-09-10T09:22:40.765114+0000","last_peered":"2024-09-10T09:22:40.765114+0000","last_clean":"2024-09-10T09:22:40.765114+0000","last_became_active":"2024-09-10T09:22:38.961126+0000","last_became_peered":"2024-09-10T09:22:38.961126+0000","last_unstale":"2024-09-10T09:22:40.765114+0000","last_undegraded":"2024-09-10T09:22:40.765114+0000","last_fullsized":"2024-09-10T09:22:40.765114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:02.197255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394408+0000","last_change":"2024-09-10T09:22:38.964013+0000","last_active":"2024-09-10T09:22:40.394408+0000","last_peered":"2024-09-10T09:22:40.394408+0000","last_clean":"2024-09-10T09:22:40.394408+0000","last_became_active":"2024-09-10T09:22:38.963768+0000","last_became_peered":"2024-09-10T09:22:38.963768+0000","last_unstale":"2024-09-10T09:22:40.394408+0000","last_undegraded":"2024-09-10T09:22:40.394408+0000","last_fullsized":"2024-09-10T09:22:40.394408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:22.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959958+0000","last_change":"2024-09-10T09:22:38.975261+0000","last_active":"2024-09-10T09:22:39.959958+0000","last_peered":"2024-09-10T09:22:39.959958+0000","last_clean":"2024-09-10T09:22:39.959958+0000","last_became_active":"2024-09-10T09:22:38.974086+0000","last_became_peered":"2024-09-10T09:22:38.974086+0000","last_unstale":"2024-09-10T09:22:39.959958+0000","last_undegraded":"2024-09-10T09:22:39.959958+0000","last_fullsized":"2024-09-10T09:22:39.959958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:54.998590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960092+0000","last_change":"2024-09-10T09:22:38.974707+0000","last_active":"2024-09-10T09:22:39.960092+0000","last_peered":"2024-09-10T09:22:39.960092+0000","last_clean":"2024-09-10T09:22:39.960092+0000","last_became_active":"2024-09-10T09:22:38.973755+0000","last_became_peered":"2024-09-10T09:22:38.973755+0000","last_unstale":"2024-09-10T09:22:39.960092+0000","last_undegraded":"2024-09-10T09:22:39.960092+0000","last_fullsized":"2024-09-10T09:22:39.960092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958724+0000","last_change":"2024-09-10T09:22:38.974678+0000","last_active":"2024-09-10T09:22:39.958724+0000","last_peered":"2024-09-10T09:22:39.958724+0000","last_clean":"2024-09-10T09:22:39.958724+0000","last_became_active":"2024-09-10T09:22:38.974415+0000","last_became_peered":"2024-09-10T09:22:38.974415+0000","last_unstale":"2024-09-10T09:22:39.958724+0000","last_undegraded":"2024-09-10T09:22:39.958724+0000","last_fullsized":"2024-09-10T09:22:39.958724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:09.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765854+0000","last_change":"2024-09-10T09:22:38.975398+0000","last_active":"2024-09-10T09:22:40.765854+0000","last_peered":"2024-09-10T09:22:40.765854+0000","last_clean":"2024-09-10T09:22:40.765854+0000","last_became_active":"2024-09-10T09:22:38.975093+0000","last_became_peered":"2024-09-10T09:22:38.975093+0000","last_unstale":"2024-09-10T09:22:40.765854+0000","last_undegraded":"2024-09-10T09:22:40.765854+0000","last_fullsized":"2024-09-10T09:22:40.765854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:03.584901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765481+0000","last_change":"2024-09-10T09:22:38.954877+0000","last_active":"2024-09-10T09:22:40.765481+0000","last_peered":"2024-09-10T09:22:40.765481+0000","last_clean":"2024-09-10T09:22:40.765481+0000","last_became_active":"2024-09-10T09:22:38.954549+0000","last_became_peered":"2024-09-10T09:22:38.954549+0000","last_unstale":"2024-09-10T09:22:40.765481+0000","last_undegraded":"2024-09-10T09:22:40.765481+0000","last_fullsized":"2024-09-10T09:22:40.765481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:50.063910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956131+0000","last_change":"2024-09-10T09:22:38.952469+0000","last_active":"2024-09-10T09:22:39.956131+0000","last_peered":"2024-09-10T09:22:39.956131+0000","last_clean":"2024-09-10T09:22:39.956131+0000","last_became_active":"2024-09-10T09:22:38.952191+0000","last_became_peered":"2024-09-10T09:22:38.952191+0000","last_unstale":"2024-09-10T09:22:39.956131+0000","last_undegraded":"2024-09-10T09:22:39.956131+0000","last_fullsized":"2024-09-10T09:22:39.956131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:08.191798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959960+0000","last_change":"2024-09-10T09:22:38.959740+0000","last_active":"2024-09-10T09:22:39.959960+0000","last_peered":"2024-09-10T09:22:39.959960+0000","last_clean":"2024-09-10T09:22:39.959960+0000","last_became_active":"2024-09-10T09:22:38.959256+0000","last_became_peered":"2024-09-10T09:22:38.959256+0000","last_unstale":"2024-09-10T09:22:39.959960+0000","last_undegraded":"2024-09-10T09:22:39.959960+0000","last_fullsized":"2024-09-10T09:22:39.959960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:41.583905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960546+0000","last_change":"2024-09-10T09:22:38.964925+0000","last_active":"2024-09-10T09:22:39.960546+0000","last_peered":"2024-09-10T09:22:39.960546+0000","last_clean":"2024-09-10T09:22:39.960546+0000","last_became_active":"2024-09-10T09:22:38.964232+0000","last_became_peered":"2024-09-10T09:22:38.964232+0000","last_unstale":"2024-09-10T09:22:39.960546+0000","last_undegraded":"2024-09-10T09:22:39.960546+0000","last_fullsized":"2024-09-10T09:22:39.960546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:24.977108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765763+0000","last_change":"2024-09-10T09:22:38.975406+0000","last_active":"2024-09-10T09:22:40.765763+0000","last_peered":"2024-09-10T09:22:40.765763+0000","last_clean":"2024-09-10T09:22:40.765763+0000","last_became_active":"2024-09-10T09:22:38.975079+0000","last_became_peered":"2024-09-10T09:22:38.975079+0000","last_unstale":"2024-09-10T09:22:40.765763+0000","last_undegraded":"2024-09-10T09:22:40.765763+0000","last_fullsized":"2024-09-10T09:22:40.765763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:57.060944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394390+0000","last_change":"2024-09-10T09:22:38.964857+0000","last_active":"2024-09-10T09:22:40.394390+0000","last_peered":"2024-09-10T09:22:40.394390+0000","last_clean":"2024-09-10T09:22:40.394390+0000","last_became_active":"2024-09-10T09:22:38.964560+0000","last_became_peered":"2024-09-10T09:22:38.964560+0000","last_unstale":"2024-09-10T09:22:40.394390+0000","last_undegraded":"2024-09-10T09:22:40.394390+0000","last_fullsized":"2024-09-10T09:22:40.394390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:39.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959976+0000","last_change":"2024-09-10T09:22:38.974897+0000","last_active":"2024-09-10T09:22:39.959976+0000","last_peered":"2024-09-10T09:22:39.959976+0000","last_clean":"2024-09-10T09:22:39.959976+0000","last_became_active":"2024-09-10T09:22:38.973651+0000","last_became_peered":"2024-09-10T09:22:38.973651+0000","last_unstale":"2024-09-10T09:22:39.959976+0000","last_undegraded":"2024-09-10T09:22:39.959976+0000","last_fullsized":"2024-09-10T09:22:39.959976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:52.643340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766099+0000","last_change":"2024-09-10T09:22:38.962723+0000","last_active":"2024-09-10T09:22:40.766099+0000","last_peered":"2024-09-10T09:22:40.766099+0000","last_clean":"2024-09-10T09:22:40.766099+0000","last_became_active":"2024-09-10T09:22:38.961742+0000","last_became_peered":"2024-09-10T09:22:38.961742+0000","last_unstale":"2024-09-10T09:22:40.766099+0000","last_undegraded":"2024-09-10T09:22:40.766099+0000","last_fullsized":"2024-09-10T09:22:40.766099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:13.126533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960421+0000","last_change":"2024-09-10T09:22:38.964016+0000","last_active":"2024-09-10T09:22:39.960421+0000","last_peered":"2024-09-10T09:22:39.960421+0000","last_clean":"2024-09-10T09:22:39.960421+0000","last_became_active":"2024-09-10T09:22:38.963653+0000","last_became_peered":"2024-09-10T09:22:38.963653+0000","last_unstale":"2024-09-10T09:22:39.960421+0000","last_undegraded":"2024-09-10T09:22:39.960421+0000","last_fullsized":"2024-09-10T09:22:39.960421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:43.775026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766037+0000","last_change":"2024-09-10T09:22:38.965644+0000","last_active":"2024-09-10T09:22:40.766037+0000","last_peered":"2024-09-10T09:22:40.766037+0000","last_clean":"2024-09-10T09:22:40.766037+0000","last_became_active":"2024-09-10T09:22:38.965355+0000","last_became_peered":"2024-09-10T09:22:38.965355+0000","last_unstale":"2024-09-10T09:22:40.766037+0000","last_undegraded":"2024-09-10T09:22:40.766037+0000","last_fullsized":"2024-09-10T09:22:40.766037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:39.185794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959707+0000","last_change":"2024-09-10T09:22:38.958547+0000","last_active":"2024-09-10T09:22:39.959707+0000","last_peered":"2024-09-10T09:22:39.959707+0000","last_clean":"2024-09-10T09:22:39.959707+0000","last_became_active":"2024-09-10T09:22:38.958063+0000","last_became_peered":"2024-09-10T09:22:38.958063+0000","last_unstale":"2024-09-10T09:22:39.959707+0000","last_undegraded":"2024-09-10T09:22:39.959707+0000","last_fullsized":"2024-09-10T09:22:39.959707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765558+0000","last_change":"2024-09-10T09:22:38.960259+0000","last_active":"2024-09-10T09:22:40.765558+0000","last_peered":"2024-09-10T09:22:40.765558+0000","last_clean":"2024-09-10T09:22:40.765558+0000","last_became_active":"2024-09-10T09:22:38.959749+0000","last_became_peered":"2024-09-10T09:22:38.959749+0000","last_unstale":"2024-09-10T09:22:40.765558+0000","last_undegraded":"2024-09-10T09:22:40.765558+0000","last_fullsized":"2024-09-10T09:22:40.765558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:57.616234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959747+0000","last_change":"2024-09-10T09:22:38.975027+0000","last_active":"2024-09-10T09:22:39.959747+0000","last_peered":"2024-09-10T09:22:39.959747+0000","last_clean":"2024-09-10T09:22:39.959747+0000","last_became_active":"2024-09-10T09:22:38.974540+0000","last_became_peered":"2024-09-10T09:22:38.974540+0000","last_unstale":"2024-09-10T09:22:39.959747+0000","last_undegraded":"2024-09-10T09:22:39.959747+0000","last_fullsized":"2024-09-10T09:22:39.959747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:55.420768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956226+0000","last_change":"2024-09-10T09:22:38.958133+0000","last_active":"2024-09-10T09:22:39.956226+0000","last_peered":"2024-09-10T09:22:39.956226+0000","last_clean":"2024-09-10T09:22:39.956226+0000","last_became_active":"2024-09-10T09:22:38.957783+0000","last_became_peered":"2024-09-10T09:22:38.957783+0000","last_unstale":"2024-09-10T09:22:39.956226+0000","last_undegraded":"2024-09-10T09:22:39.956226+0000","last_fullsized":"2024-09-10T09:22:39.956226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:57.616234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765919+0000","last_change":"2024-09-10T09:22:38.965849+0000","last_active":"2024-09-10T09:22:40.765919+0000","last_peered":"2024-09-10T09:22:40.765919+0000","last_clean":"2024-09-10T09:22:40.765919+0000","last_became_active":"2024-09-10T09:22:38.965247+0000","last_became_peered":"2024-09-10T09:22:38.965247+0000","last_unstale":"2024-09-10T09:22:40.765919+0000","last_undegraded":"2024-09-10T09:22:40.765919+0000","last_fullsized":"2024-09-10T09:22:40.765919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:43.411921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766324+0000","last_change":"2024-09-10T09:22:38.956629+0000","last_active":"2024-09-10T09:22:40.766324+0000","last_peered":"2024-09-10T09:22:40.766324+0000","last_clean":"2024-09-10T09:22:40.766324+0000","last_became_active":"2024-09-10T09:22:38.956335+0000","last_became_peered":"2024-09-10T09:22:38.956335+0000","last_unstale":"2024-09-10T09:22:40.766324+0000","last_undegraded":"2024-09-10T09:22:40.766324+0000","last_fullsized":"2024-09-10T09:22:40.766324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:54.998590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960500+0000","last_change":"2024-09-10T09:22:38.960158+0000","last_active":"2024-09-10T09:22:39.960500+0000","last_peered":"2024-09-10T09:22:39.960500+0000","last_clean":"2024-09-10T09:22:39.960500+0000","last_became_active":"2024-09-10T09:22:38.959580+0000","last_became_peered":"2024-09-10T09:22:38.959580+0000","last_unstale":"2024-09-10T09:22:39.960500+0000","last_undegraded":"2024-09-10T09:22:39.960500+0000","last_fullsized":"2024-09-10T09:22:39.960500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:42.311244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765707+0000","last_change":"2024-09-10T09:22:38.960529+0000","last_active":"2024-09-10T09:22:40.765707+0000","last_peered":"2024-09-10T09:22:40.765707+0000","last_clean":"2024-09-10T09:22:40.765707+0000","last_became_active":"2024-09-10T09:22:38.960209+0000","last_became_peered":"2024-09-10T09:22:38.960209+0000","last_unstale":"2024-09-10T09:22:40.765707+0000","last_undegraded":"2024-09-10T09:22:40.765707+0000","last_fullsized":"2024-09-10T09:22:40.765707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:31.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959265+0000","last_change":"2024-09-10T09:22:38.974404+0000","last_active":"2024-09-10T09:22:39.959265+0000","last_peered":"2024-09-10T09:22:39.959265+0000","last_clean":"2024-09-10T09:22:39.959265+0000","last_became_active":"2024-09-10T09:22:38.973533+0000","last_became_peered":"2024-09-10T09:22:38.973533+0000","last_unstale":"2024-09-10T09:22:39.959265+0000","last_undegraded":"2024-09-10T09:22:39.959265+0000","last_fullsized":"2024-09-10T09:22:39.959265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:07.172679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958530+0000","last_change":"2024-09-10T09:22:38.954218+0000","last_active":"2024-09-10T09:22:39.958530+0000","last_peered":"2024-09-10T09:22:39.958530+0000","last_clean":"2024-09-10T09:22:39.958530+0000","last_became_active":"2024-09-10T09:22:38.953944+0000","last_became_peered":"2024-09-10T09:22:38.953944+0000","last_unstale":"2024-09-10T09:22:39.958530+0000","last_undegraded":"2024-09-10T09:22:39.958530+0000","last_fullsized":"2024-09-10T09:22:39.958530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:51.764396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766086+0000","last_change":"2024-09-10T09:22:37.936550+0000","last_active":"2024-09-10T09:22:40.766086+0000","last_peered":"2024-09-10T09:22:40.766086+0000","last_clean":"2024-09-10T09:22:40.766086+0000","last_became_active":"2024-09-10T09:22:37.936210+0000","last_became_peered":"2024-09-10T09:22:37.936210+0000","last_unstale":"2024-09-10T09:22:40.766086+0000","last_undegraded":"2024-09-10T09:22:40.766086+0000","last_fullsized":"2024-09-10T09:22:40.766086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:23.206231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766490+0000","last_change":"2024-09-10T09:22:38.952425+0000","last_active":"2024-09-10T09:22:40.766490+0000","last_peered":"2024-09-10T09:22:40.766490+0000","last_clean":"2024-09-10T09:22:40.766490+0000","last_became_active":"2024-09-10T09:22:38.952127+0000","last_became_peered":"2024-09-10T09:22:38.952127+0000","last_unstale":"2024-09-10T09:22:40.766490+0000","last_undegraded":"2024-09-10T09:22:40.766490+0000","last_fullsized":"2024-09-10T09:22:40.766490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959522+0000","last_change":"2024-09-10T09:22:37.933314+0000","last_active":"2024-09-10T09:22:39.959522+0000","last_peered":"2024-09-10T09:22:39.959522+0000","last_clean":"2024-09-10T09:22:39.959522+0000","last_became_active":"2024-09-10T09:22:37.933023+0000","last_became_peered":"2024-09-10T09:22:37.933023+0000","last_unstale":"2024-09-10T09:22:39.959522+0000","last_undegraded":"2024-09-10T09:22:39.959522+0000","last_fullsized":"2024-09-10T09:22:39.959522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766210+0000","last_change":"2024-09-10T09:22:37.938729+0000","last_active":"2024-09-10T09:22:40.766210+0000","last_peered":"2024-09-10T09:22:40.766210+0000","last_clean":"2024-09-10T09:22:40.766210+0000","last_became_active":"2024-09-10T09:22:37.938423+0000","last_became_peered":"2024-09-10T09:22:37.938423+0000","last_unstale":"2024-09-10T09:22:40.766210+0000","last_undegraded":"2024-09-10T09:22:40.766210+0000","last_fullsized":"2024-09-10T09:22:40.766210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:49.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765295+0000","last_change":"2024-09-10T09:22:38.971494+0000","last_active":"2024-09-10T09:22:40.765295+0000","last_peered":"2024-09-10T09:22:40.765295+0000","last_clean":"2024-09-10T09:22:40.765295+0000","last_became_active":"2024-09-10T09:22:38.971139+0000","last_became_peered":"2024-09-10T09:22:38.971139+0000","last_unstale":"2024-09-10T09:22:40.765295+0000","last_undegraded":"2024-09-10T09:22:40.765295+0000","last_fullsized":"2024-09-10T09:22:40.765295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:19.609624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959768+0000","last_change":"2024-09-10T09:22:37.935606+0000","last_active":"2024-09-10T09:22:39.959768+0000","last_peered":"2024-09-10T09:22:39.959768+0000","last_clean":"2024-09-10T09:22:39.959768+0000","last_became_active":"2024-09-10T09:22:37.935277+0000","last_became_peered":"2024-09-10T09:22:37.935277+0000","last_unstale":"2024-09-10T09:22:39.959768+0000","last_undegraded":"2024-09-10T09:22:39.959768+0000","last_fullsized":"2024-09-10T09:22:39.959768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956122+0000","last_change":"2024-09-10T09:22:38.958931+0000","last_active":"2024-09-10T09:22:39.956122+0000","last_peered":"2024-09-10T09:22:39.956122+0000","last_clean":"2024-09-10T09:22:39.956122+0000","last_became_active":"2024-09-10T09:22:38.958607+0000","last_became_peered":"2024-09-10T09:22:38.958607+0000","last_unstale":"2024-09-10T09:22:39.956122+0000","last_undegraded":"2024-09-10T09:22:39.956122+0000","last_fullsized":"2024-09-10T09:22:39.956122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:19.609624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959625+0000","last_change":"2024-09-10T09:22:37.935791+0000","last_active":"2024-09-10T09:22:39.959625+0000","last_peered":"2024-09-10T09:22:39.959625+0000","last_clean":"2024-09-10T09:22:39.959625+0000","last_became_active":"2024-09-10T09:22:37.935513+0000","last_became_peered":"2024-09-10T09:22:37.935513+0000","last_unstale":"2024-09-10T09:22:39.959625+0000","last_undegraded":"2024-09-10T09:22:39.959625+0000","last_fullsized":"2024-09-10T09:22:39.959625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960442+0000","last_change":"2024-09-10T09:22:38.962591+0000","last_active":"2024-09-10T09:22:39.960442+0000","last_peered":"2024-09-10T09:22:39.960442+0000","last_clean":"2024-09-10T09:22:39.960442+0000","last_became_active":"2024-09-10T09:22:38.962315+0000","last_became_peered":"2024-09-10T09:22:38.962315+0000","last_unstale":"2024-09-10T09:22:39.960442+0000","last_undegraded":"2024-09-10T09:22:39.960442+0000","last_fullsized":"2024-09-10T09:22:39.960442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:52.288196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960253+0000","last_change":"2024-09-10T09:22:37.935382+0000","last_active":"2024-09-10T09:22:39.960253+0000","last_peered":"2024-09-10T09:22:39.960253+0000","last_clean":"2024-09-10T09:22:39.960253+0000","last_became_active":"2024-09-10T09:22:37.935104+0000","last_became_peered":"2024-09-10T09:22:37.935104+0000","last_unstale":"2024-09-10T09:22:39.960253+0000","last_undegraded":"2024-09-10T09:22:39.960253+0000","last_fullsized":"2024-09-10T09:22:39.960253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766147+0000","last_change":"2024-09-10T09:22:38.960788+0000","last_active":"2024-09-10T09:22:40.766147+0000","last_peered":"2024-09-10T09:22:40.766147+0000","last_clean":"2024-09-10T09:22:40.766147+0000","last_became_active":"2024-09-10T09:22:38.960491+0000","last_became_peered":"2024-09-10T09:22:38.960491+0000","last_unstale":"2024-09-10T09:22:40.766147+0000","last_undegraded":"2024-09-10T09:22:40.766147+0000","last_fullsized":"2024-09-10T09:22:40.766147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:55.420768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956170+0000","last_change":"2024-09-10T09:22:37.937277+0000","last_active":"2024-09-10T09:22:39.956170+0000","last_peered":"2024-09-10T09:22:39.956170+0000","last_clean":"2024-09-10T09:22:39.956170+0000","last_became_active":"2024-09-10T09:22:37.936910+0000","last_became_peered":"2024-09-10T09:22:37.936910+0000","last_unstale":"2024-09-10T09:22:39.956170+0000","last_undegraded":"2024-09-10T09:22:39.956170+0000","last_fullsized":"2024-09-10T09:22:39.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:32.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958793+0000","last_change":"2024-09-10T09:22:38.962851+0000","last_active":"2024-09-10T09:22:39.958793+0000","last_peered":"2024-09-10T09:22:39.958793+0000","last_clean":"2024-09-10T09:22:39.958793+0000","last_became_active":"2024-09-10T09:22:38.962592+0000","last_became_peered":"2024-09-10T09:22:38.962592+0000","last_unstale":"2024-09-10T09:22:39.958793+0000","last_undegraded":"2024-09-10T09:22:39.958793+0000","last_fullsized":"2024-09-10T09:22:39.958793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:43.844370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960039+0000","last_change":"2024-09-10T09:22:37.940171+0000","last_active":"2024-09-10T09:22:39.960039+0000","last_peered":"2024-09-10T09:22:39.960039+0000","last_clean":"2024-09-10T09:22:39.960039+0000","last_became_active":"2024-09-10T09:22:37.939839+0000","last_became_peered":"2024-09-10T09:22:37.939839+0000","last_unstale":"2024-09-10T09:22:39.960039+0000","last_undegraded":"2024-09-10T09:22:39.960039+0000","last_fullsized":"2024-09-10T09:22:39.960039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394148+0000","last_change":"2024-09-10T09:22:38.966134+0000","last_active":"2024-09-10T09:22:40.394148+0000","last_peered":"2024-09-10T09:22:40.394148+0000","last_clean":"2024-09-10T09:22:40.394148+0000","last_became_active":"2024-09-10T09:22:38.965850+0000","last_became_peered":"2024-09-10T09:22:38.965850+0000","last_unstale":"2024-09-10T09:22:40.394148+0000","last_undegraded":"2024-09-10T09:22:40.394148+0000","last_fullsized":"2024-09-10T09:22:40.394148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:52.288196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766436+0000","last_change":"2024-09-10T09:22:37.934809+0000","last_active":"2024-09-10T09:22:40.766436+0000","last_peered":"2024-09-10T09:22:40.766436+0000","last_clean":"2024-09-10T09:22:40.766436+0000","last_became_active":"2024-09-10T09:22:37.934290+0000","last_became_peered":"2024-09-10T09:22:37.934290+0000","last_unstale":"2024-09-10T09:22:40.766436+0000","last_undegraded":"2024-09-10T09:22:40.766436+0000","last_fullsized":"2024-09-10T09:22:40.766436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:24.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765636+0000","last_change":"2024-09-10T09:22:38.961877+0000","last_active":"2024-09-10T09:22:40.765636+0000","last_peered":"2024-09-10T09:22:40.765636+0000","last_clean":"2024-09-10T09:22:40.765636+0000","last_became_active":"2024-09-10T09:22:38.961552+0000","last_became_peered":"2024-09-10T09:22:38.961552+0000","last_unstale":"2024-09-10T09:22:40.765636+0000","last_undegraded":"2024-09-10T09:22:40.765636+0000","last_fullsized":"2024-09-10T09:22:40.765636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:17.820088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960481+0000","last_change":"2024-09-10T09:22:37.930753+0000","last_active":"2024-09-10T09:22:39.960481+0000","last_peered":"2024-09-10T09:22:39.960481+0000","last_clean":"2024-09-10T09:22:39.960481+0000","last_became_active":"2024-09-10T09:22:37.930430+0000","last_became_peered":"2024-09-10T09:22:37.930430+0000","last_unstale":"2024-09-10T09:22:39.960481+0000","last_undegraded":"2024-09-10T09:22:39.960481+0000","last_fullsized":"2024-09-10T09:22:39.960481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394076+0000","last_change":"2024-09-10T09:22:38.967848+0000","last_active":"2024-09-10T09:22:40.394076+0000","last_peered":"2024-09-10T09:22:40.394076+0000","last_clean":"2024-09-10T09:22:40.394076+0000","last_became_active":"2024-09-10T09:22:38.967573+0000","last_became_peered":"2024-09-10T09:22:38.967573+0000","last_unstale":"2024-09-10T09:22:40.394076+0000","last_undegraded":"2024-09-10T09:22:40.394076+0000","last_fullsized":"2024-09-10T09:22:40.394076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:43.775026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959289+0000","last_change":"2024-09-10T09:22:37.938173+0000","last_active":"2024-09-10T09:22:39.959289+0000","last_peered":"2024-09-10T09:22:39.959289+0000","last_clean":"2024-09-10T09:22:39.959289+0000","last_became_active":"2024-09-10T09:22:37.937876+0000","last_became_peered":"2024-09-10T09:22:37.937876+0000","last_unstale":"2024-09-10T09:22:39.959289+0000","last_undegraded":"2024-09-10T09:22:39.959289+0000","last_fullsized":"2024-09-10T09:22:39.959289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:47.182456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959422+0000","last_change":"2024-09-10T09:22:38.970503+0000","last_active":"2024-09-10T09:22:39.959422+0000","last_peered":"2024-09-10T09:22:39.959422+0000","last_clean":"2024-09-10T09:22:39.959422+0000","last_became_active":"2024-09-10T09:22:38.970224+0000","last_became_peered":"2024-09-10T09:22:38.970224+0000","last_unstale":"2024-09-10T09:22:39.959422+0000","last_undegraded":"2024-09-10T09:22:39.959422+0000","last_fullsized":"2024-09-10T09:22:39.959422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:13.126533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.764935+0000","last_change":"2024-09-10T09:22:37.933753+0000","last_active":"2024-09-10T09:22:40.764935+0000","last_peered":"2024-09-10T09:22:40.764935+0000","last_clean":"2024-09-10T09:22:40.764935+0000","last_became_active":"2024-09-10T09:22:37.933380+0000","last_became_peered":"2024-09-10T09:22:37.933380+0000","last_unstale":"2024-09-10T09:22:40.764935+0000","last_undegraded":"2024-09-10T09:22:40.764935+0000","last_fullsized":"2024-09-10T09:22:40.764935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:27.520559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393904+0000","last_change":"2024-09-10T09:22:38.962249+0000","last_active":"2024-09-10T09:22:40.393904+0000","last_peered":"2024-09-10T09:22:40.393904+0000","last_clean":"2024-09-10T09:22:40.393904+0000","last_became_active":"2024-09-10T09:22:38.961485+0000","last_became_peered":"2024-09-10T09:22:38.961485+0000","last_unstale":"2024-09-10T09:22:40.393904+0000","last_undegraded":"2024-09-10T09:22:40.393904+0000","last_fullsized":"2024-09-10T09:22:40.393904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958733+0000","last_change":"2024-09-10T09:22:37.934159+0000","last_active":"2024-09-10T09:22:39.958733+0000","last_peered":"2024-09-10T09:22:39.958733+0000","last_clean":"2024-09-10T09:22:39.958733+0000","last_became_active":"2024-09-10T09:22:37.933759+0000","last_became_peered":"2024-09-10T09:22:37.933759+0000","last_unstale":"2024-09-10T09:22:39.958733+0000","last_undegraded":"2024-09-10T09:22:39.958733+0000","last_fullsized":"2024-09-10T09:22:39.958733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.720468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394303+0000","last_change":"2024-09-10T09:22:38.961879+0000","last_active":"2024-09-10T09:22:40.394303+0000","last_peered":"2024-09-10T09:22:40.394303+0000","last_clean":"2024-09-10T09:22:40.394303+0000","last_became_active":"2024-09-10T09:22:38.961575+0000","last_became_peered":"2024-09-10T09:22:38.961575+0000","last_unstale":"2024-09-10T09:22:40.394303+0000","last_undegraded":"2024-09-10T09:22:40.394303+0000","last_fullsized":"2024-09-10T09:22:40.394303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:32.085819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765573+0000","last_change":"2024-09-10T09:22:37.933460+0000","last_active":"2024-09-10T09:22:40.765573+0000","last_peered":"2024-09-10T09:22:40.765573+0000","last_clean":"2024-09-10T09:22:40.765573+0000","last_became_active":"2024-09-10T09:22:37.933122+0000","last_became_peered":"2024-09-10T09:22:37.933122+0000","last_unstale":"2024-09-10T09:22:40.765573+0000","last_undegraded":"2024-09-10T09:22:40.765573+0000","last_fullsized":"2024-09-10T09:22:40.765573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394516+0000","last_change":"2024-09-10T09:22:38.962830+0000","last_active":"2024-09-10T09:22:40.394516+0000","last_peered":"2024-09-10T09:22:40.394516+0000","last_clean":"2024-09-10T09:22:40.394516+0000","last_became_active":"2024-09-10T09:22:38.962492+0000","last_became_peered":"2024-09-10T09:22:38.962492+0000","last_unstale":"2024-09-10T09:22:40.394516+0000","last_undegraded":"2024-09-10T09:22:40.394516+0000","last_fullsized":"2024-09-10T09:22:40.394516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:49.985776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956292+0000","last_change":"2024-09-10T09:22:37.933280+0000","last_active":"2024-09-10T09:22:39.956292+0000","last_peered":"2024-09-10T09:22:39.956292+0000","last_clean":"2024-09-10T09:22:39.956292+0000","last_became_active":"2024-09-10T09:22:37.933030+0000","last_became_peered":"2024-09-10T09:22:37.933030+0000","last_unstale":"2024-09-10T09:22:39.956292+0000","last_undegraded":"2024-09-10T09:22:39.956292+0000","last_fullsized":"2024-09-10T09:22:39.956292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:45.005434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960085+0000","last_change":"2024-09-10T09:22:38.959317+0000","last_active":"2024-09-10T09:22:39.960085+0000","last_peered":"2024-09-10T09:22:39.960085+0000","last_clean":"2024-09-10T09:22:39.960085+0000","last_became_active":"2024-09-10T09:22:38.958283+0000","last_became_peered":"2024-09-10T09:22:38.958283+0000","last_unstale":"2024-09-10T09:22:39.960085+0000","last_undegraded":"2024-09-10T09:22:39.960085+0000","last_fullsized":"2024-09-10T09:22:39.960085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:26.724466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765432+0000","last_change":"2024-09-10T09:22:37.929435+0000","last_active":"2024-09-10T09:22:40.765432+0000","last_peered":"2024-09-10T09:22:40.765432+0000","last_clean":"2024-09-10T09:22:40.765432+0000","last_became_active":"2024-09-10T09:22:37.929161+0000","last_became_peered":"2024-09-10T09:22:37.929161+0000","last_unstale":"2024-09-10T09:22:40.765432+0000","last_undegraded":"2024-09-10T09:22:40.765432+0000","last_fullsized":"2024-09-10T09:22:40.765432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394200+0000","last_change":"2024-09-10T09:22:38.964246+0000","last_active":"2024-09-10T09:22:40.394200+0000","last_peered":"2024-09-10T09:22:40.394200+0000","last_clean":"2024-09-10T09:22:40.394200+0000","last_became_active":"2024-09-10T09:22:38.964000+0000","last_became_peered":"2024-09-10T09:22:38.964000+0000","last_unstale":"2024-09-10T09:22:40.394200+0000","last_undegraded":"2024-09-10T09:22:40.394200+0000","last_fullsized":"2024-09-10T09:22:40.394200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:42.311244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393715+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:22:40.393715+0000","last_peered":"2024-09-10T09:22:40.393715+0000","last_clean":"2024-09-10T09:22:40.393715+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:22:40.393715+0000","last_undegraded":"2024-09-10T09:22:40.393715+0000","last_fullsized":"2024-09-10T09:22:40.393715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959675+0000","last_change":"2024-09-10T09:22:37.924543+0000","last_active":"2024-09-10T09:22:39.959675+0000","last_peered":"2024-09-10T09:22:39.959675+0000","last_clean":"2024-09-10T09:22:39.959675+0000","last_became_active":"2024-09-10T09:22:37.924170+0000","last_became_peered":"2024-09-10T09:22:37.924170+0000","last_unstale":"2024-09-10T09:22:39.959675+0000","last_undegraded":"2024-09-10T09:22:39.959675+0000","last_fullsized":"2024-09-10T09:22:39.959675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766370+0000","last_change":"2024-09-10T09:22:38.962024+0000","last_active":"2024-09-10T09:22:40.766370+0000","last_peered":"2024-09-10T09:22:40.766370+0000","last_clean":"2024-09-10T09:22:40.766370+0000","last_became_active":"2024-09-10T09:22:38.961394+0000","last_became_peered":"2024-09-10T09:22:38.961394+0000","last_unstale":"2024-09-10T09:22:40.766370+0000","last_undegraded":"2024-09-10T09:22:40.766370+0000","last_fullsized":"2024-09-10T09:22:40.766370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:25.333541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393609+0000","last_change":"2024-09-10T09:22:37.937745+0000","last_active":"2024-09-10T09:22:40.393609+0000","last_peered":"2024-09-10T09:22:40.393609+0000","last_clean":"2024-09-10T09:22:40.393609+0000","last_became_active":"2024-09-10T09:22:37.937135+0000","last_became_peered":"2024-09-10T09:22:37.937135+0000","last_unstale":"2024-09-10T09:22:40.393609+0000","last_undegraded":"2024-09-10T09:22:40.393609+0000","last_fullsized":"2024-09-10T09:22:40.393609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.764993+0000","last_change":"2024-09-10T09:22:38.950945+0000","last_active":"2024-09-10T09:22:40.764993+0000","last_peered":"2024-09-10T09:22:40.764993+0000","last_clean":"2024-09-10T09:22:40.764993+0000","last_became_active":"2024-09-10T09:22:38.950620+0000","last_became_peered":"2024-09-10T09:22:38.950620+0000","last_unstale":"2024-09-10T09:22:40.764993+0000","last_undegraded":"2024-09-10T09:22:40.764993+0000","last_fullsized":"2024-09-10T09:22:40.764993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.669603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765326+0000","last_change":"2024-09-10T09:22:37.932613+0000","last_active":"2024-09-10T09:22:40.765326+0000","last_peered":"2024-09-10T09:22:40.765326+0000","last_clean":"2024-09-10T09:22:40.765326+0000","last_became_active":"2024-09-10T09:22:37.932294+0000","last_became_peered":"2024-09-10T09:22:37.932294+0000","last_unstale":"2024-09-10T09:22:40.765326+0000","last_undegraded":"2024-09-10T09:22:40.765326+0000","last_fullsized":"2024-09-10T09:22:40.765326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:47.182456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956126+0000","last_change":"2024-09-10T09:22:38.953678+0000","last_active":"2024-09-10T09:22:39.956126+0000","last_peered":"2024-09-10T09:22:39.956126+0000","last_clean":"2024-09-10T09:22:39.956126+0000","last_became_active":"2024-09-10T09:22:38.953377+0000","last_became_peered":"2024-09-10T09:22:38.953377+0000","last_unstale":"2024-09-10T09:22:39.956126+0000","last_undegraded":"2024-09-10T09:22:39.956126+0000","last_fullsized":"2024-09-10T09:22:39.956126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:38.287488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960562+0000","last_change":"2024-09-10T09:22:37.933538+0000","last_active":"2024-09-10T09:22:39.960562+0000","last_peered":"2024-09-10T09:22:39.960562+0000","last_clean":"2024-09-10T09:22:39.960562+0000","last_became_active":"2024-09-10T09:22:37.933239+0000","last_became_peered":"2024-09-10T09:22:37.933239+0000","last_unstale":"2024-09-10T09:22:39.960562+0000","last_undegraded":"2024-09-10T09:22:39.960562+0000","last_fullsized":"2024-09-10T09:22:39.960562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958827+0000","last_change":"2024-09-10T09:22:38.958116+0000","last_active":"2024-09-10T09:22:39.958827+0000","last_peered":"2024-09-10T09:22:39.958827+0000","last_clean":"2024-09-10T09:22:39.958827+0000","last_became_active":"2024-09-10T09:22:38.957831+0000","last_became_peered":"2024-09-10T09:22:38.957831+0000","last_unstale":"2024-09-10T09:22:39.958827+0000","last_undegraded":"2024-09-10T09:22:39.958827+0000","last_fullsized":"2024-09-10T09:22:39.958827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:26.169482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956283+0000","last_change":"2024-09-10T09:22:37.931279+0000","last_active":"2024-09-10T09:22:39.956283+0000","last_peered":"2024-09-10T09:22:39.956283+0000","last_clean":"2024-09-10T09:22:39.956283+0000","last_became_active":"2024-09-10T09:22:37.930991+0000","last_became_peered":"2024-09-10T09:22:37.930991+0000","last_unstale":"2024-09-10T09:22:39.956283+0000","last_undegraded":"2024-09-10T09:22:39.956283+0000","last_fullsized":"2024-09-10T09:22:39.956283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:25.167130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960530+0000","last_change":"2024-09-10T09:22:38.962689+0000","last_active":"2024-09-10T09:22:39.960530+0000","last_peered":"2024-09-10T09:22:39.960530+0000","last_clean":"2024-09-10T09:22:39.960530+0000","last_became_active":"2024-09-10T09:22:38.962301+0000","last_became_peered":"2024-09-10T09:22:38.962301+0000","last_unstale":"2024-09-10T09:22:39.960530+0000","last_undegraded":"2024-09-10T09:22:39.960530+0000","last_fullsized":"2024-09-10T09:22:39.960530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:39.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394321+0000","last_change":"2024-09-10T09:22:37.936685+0000","last_active":"2024-09-10T09:22:40.394321+0000","last_peered":"2024-09-10T09:22:40.394321+0000","last_clean":"2024-09-10T09:22:40.394321+0000","last_became_active":"2024-09-10T09:22:37.936351+0000","last_became_peered":"2024-09-10T09:22:37.936351+0000","last_unstale":"2024-09-10T09:22:40.394321+0000","last_undegraded":"2024-09-10T09:22:40.394321+0000","last_fullsized":"2024-09-10T09:22:40.394321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:45.574031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956260+0000","last_change":"2024-09-10T09:22:38.953660+0000","last_active":"2024-09-10T09:22:39.956260+0000","last_peered":"2024-09-10T09:22:39.956260+0000","last_clean":"2024-09-10T09:22:39.956260+0000","last_became_active":"2024-09-10T09:22:38.953385+0000","last_became_peered":"2024-09-10T09:22:38.953385+0000","last_unstale":"2024-09-10T09:22:39.956260+0000","last_undegraded":"2024-09-10T09:22:39.956260+0000","last_fullsized":"2024-09-10T09:22:39.956260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:39.464012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956275+0000","last_change":"2024-09-10T09:22:37.935773+0000","last_active":"2024-09-10T09:22:39.956275+0000","last_peered":"2024-09-10T09:22:39.956275+0000","last_clean":"2024-09-10T09:22:39.956275+0000","last_became_active":"2024-09-10T09:22:37.934987+0000","last_became_peered":"2024-09-10T09:22:37.934987+0000","last_unstale":"2024-09-10T09:22:39.956275+0000","last_undegraded":"2024-09-10T09:22:39.956275+0000","last_fullsized":"2024-09-10T09:22:39.956275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:50.762044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765703+0000","last_change":"2024-09-10T09:22:38.967459+0000","last_active":"2024-09-10T09:22:40.765703+0000","last_peered":"2024-09-10T09:22:40.765703+0000","last_clean":"2024-09-10T09:22:40.765703+0000","last_became_active":"2024-09-10T09:22:38.967196+0000","last_became_peered":"2024-09-10T09:22:38.967196+0000","last_unstale":"2024-09-10T09:22:40.765703+0000","last_undegraded":"2024-09-10T09:22:40.765703+0000","last_fullsized":"2024-09-10T09:22:40.765703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:39.464012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959741+0000","last_change":"2024-09-10T09:22:37.933918+0000","last_active":"2024-09-10T09:22:39.959741+0000","last_peered":"2024-09-10T09:22:39.959741+0000","last_clean":"2024-09-10T09:22:39.959741+0000","last_became_active":"2024-09-10T09:22:37.933296+0000","last_became_peered":"2024-09-10T09:22:37.933296+0000","last_unstale":"2024-09-10T09:22:39.959741+0000","last_undegraded":"2024-09-10T09:22:39.959741+0000","last_fullsized":"2024-09-10T09:22:39.959741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766192+0000","last_change":"2024-09-10T09:22:38.955166+0000","last_active":"2024-09-10T09:22:40.766192+0000","last_peered":"2024-09-10T09:22:40.766192+0000","last_clean":"2024-09-10T09:22:40.766192+0000","last_became_active":"2024-09-10T09:22:38.954427+0000","last_became_peered":"2024-09-10T09:22:38.954427+0000","last_unstale":"2024-09-10T09:22:40.766192+0000","last_undegraded":"2024-09-10T09:22:40.766192+0000","last_fullsized":"2024-09-10T09:22:40.766192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:06.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393603+0000","last_change":"2024-09-10T09:22:37.937409+0000","last_active":"2024-09-10T09:22:40.393603+0000","last_peered":"2024-09-10T09:22:40.393603+0000","last_clean":"2024-09-10T09:22:40.393603+0000","last_became_active":"2024-09-10T09:22:37.937072+0000","last_became_peered":"2024-09-10T09:22:37.937072+0000","last_unstale":"2024-09-10T09:22:40.393603+0000","last_undegraded":"2024-09-10T09:22:40.393603+0000","last_fullsized":"2024-09-10T09:22:40.393603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958268+0000","last_change":"2024-09-10T09:22:38.953130+0000","last_active":"2024-09-10T09:22:39.958268+0000","last_peered":"2024-09-10T09:22:39.958268+0000","last_clean":"2024-09-10T09:22:39.958268+0000","last_became_active":"2024-09-10T09:22:38.952716+0000","last_became_peered":"2024-09-10T09:22:38.952716+0000","last_unstale":"2024-09-10T09:22:39.958268+0000","last_undegraded":"2024-09-10T09:22:39.958268+0000","last_fullsized":"2024-09-10T09:22:39.958268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:46.007786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956251+0000","last_change":"2024-09-10T09:22:37.936227+0000","last_active":"2024-09-10T09:22:39.956251+0000","last_peered":"2024-09-10T09:22:39.956251+0000","last_clean":"2024-09-10T09:22:39.956251+0000","last_became_active":"2024-09-10T09:22:37.935936+0000","last_became_peered":"2024-09-10T09:22:37.935936+0000","last_unstale":"2024-09-10T09:22:39.956251+0000","last_undegraded":"2024-09-10T09:22:39.956251+0000","last_fullsized":"2024-09-10T09:22:39.956251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:08.115626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765478+0000","last_change":"2024-09-10T09:22:38.956190+0000","last_active":"2024-09-10T09:22:40.765478+0000","last_peered":"2024-09-10T09:22:40.765478+0000","last_clean":"2024-09-10T09:22:40.765478+0000","last_became_active":"2024-09-10T09:22:38.955905+0000","last_became_peered":"2024-09-10T09:22:38.955905+0000","last_unstale":"2024-09-10T09:22:40.765478+0000","last_undegraded":"2024-09-10T09:22:40.765478+0000","last_fullsized":"2024-09-10T09:22:40.765478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:08.191798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956124+0000","last_change":"2024-09-10T09:22:37.932705+0000","last_active":"2024-09-10T09:22:39.956124+0000","last_peered":"2024-09-10T09:22:39.956124+0000","last_clean":"2024-09-10T09:22:39.956124+0000","last_became_active":"2024-09-10T09:22:37.932417+0000","last_became_peered":"2024-09-10T09:22:37.932417+0000","last_unstale":"2024-09-10T09:22:39.956124+0000","last_undegraded":"2024-09-10T09:22:39.956124+0000","last_fullsized":"2024-09-10T09:22:39.956124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:42.842018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766025+0000","last_change":"2024-09-10T09:22:38.971397+0000","last_active":"2024-09-10T09:22:40.766025+0000","last_peered":"2024-09-10T09:22:40.766025+0000","last_clean":"2024-09-10T09:22:40.766025+0000","last_became_active":"2024-09-10T09:22:38.971061+0000","last_became_peered":"2024-09-10T09:22:38.971061+0000","last_unstale":"2024-09-10T09:22:40.766025+0000","last_undegraded":"2024-09-10T09:22:40.766025+0000","last_fullsized":"2024-09-10T09:22:40.766025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:15.366046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394084+0000","last_change":"2024-09-10T09:22:37.935050+0000","last_active":"2024-09-10T09:22:40.394084+0000","last_peered":"2024-09-10T09:22:40.394084+0000","last_clean":"2024-09-10T09:22:40.394084+0000","last_became_active":"2024-09-10T09:22:37.934776+0000","last_became_peered":"2024-09-10T09:22:37.934776+0000","last_unstale":"2024-09-10T09:22:40.394084+0000","last_undegraded":"2024-09-10T09:22:40.394084+0000","last_fullsized":"2024-09-10T09:22:40.394084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:56.058592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959848+0000","last_change":"2024-09-10T09:22:38.972540+0000","last_active":"2024-09-10T09:22:39.959848+0000","last_peered":"2024-09-10T09:22:39.959848+0000","last_clean":"2024-09-10T09:22:39.959848+0000","last_became_active":"2024-09-10T09:22:38.972250+0000","last_became_peered":"2024-09-10T09:22:38.972250+0000","last_unstale":"2024-09-10T09:22:39.959848+0000","last_undegraded":"2024-09-10T09:22:39.959848+0000","last_fullsized":"2024-09-10T09:22:39.959848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:06.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960526+0000","last_change":"2024-09-10T09:22:38.969444+0000","last_active":"2024-09-10T09:22:39.960526+0000","last_peered":"2024-09-10T09:22:39.960526+0000","last_clean":"2024-09-10T09:22:39.960526+0000","last_became_active":"2024-09-10T09:22:38.968894+0000","last_became_peered":"2024-09-10T09:22:38.968894+0000","last_unstale":"2024-09-10T09:22:39.960526+0000","last_undegraded":"2024-09-10T09:22:39.960526+0000","last_fullsized":"2024-09-10T09:22:39.960526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:32.085819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393977+0000","last_change":"2024-09-10T09:22:37.935751+0000","last_active":"2024-09-10T09:22:40.393977+0000","last_peered":"2024-09-10T09:22:40.393977+0000","last_clean":"2024-09-10T09:22:40.393977+0000","last_became_active":"2024-09-10T09:22:37.935466+0000","last_became_peered":"2024-09-10T09:22:37.935466+0000","last_unstale":"2024-09-10T09:22:40.393977+0000","last_undegraded":"2024-09-10T09:22:40.393977+0000","last_fullsized":"2024-09-10T09:22:40.393977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960197+0000","last_change":"2024-09-10T09:22:38.969161+0000","last_active":"2024-09-10T09:22:39.960197+0000","last_peered":"2024-09-10T09:22:39.960197+0000","last_clean":"2024-09-10T09:22:39.960197+0000","last_became_active":"2024-09-10T09:22:38.968833+0000","last_became_peered":"2024-09-10T09:22:38.968833+0000","last_unstale":"2024-09-10T09:22:39.960197+0000","last_undegraded":"2024-09-10T09:22:39.960197+0000","last_fullsized":"2024-09-10T09:22:39.960197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:08.149787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394206+0000","last_change":"2024-09-10T09:22:37.938067+0000","last_active":"2024-09-10T09:22:40.394206+0000","last_peered":"2024-09-10T09:22:40.394206+0000","last_clean":"2024-09-10T09:22:40.394206+0000","last_became_active":"2024-09-10T09:22:37.937760+0000","last_became_peered":"2024-09-10T09:22:37.937760+0000","last_unstale":"2024-09-10T09:22:40.394206+0000","last_undegraded":"2024-09-10T09:22:40.394206+0000","last_fullsized":"2024-09-10T09:22:40.394206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:09.281127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765966+0000","last_change":"2024-09-10T09:22:38.960874+0000","last_active":"2024-09-10T09:22:40.765966+0000","last_peered":"2024-09-10T09:22:40.765966+0000","last_clean":"2024-09-10T09:22:40.765966+0000","last_became_active":"2024-09-10T09:22:38.960543+0000","last_became_peered":"2024-09-10T09:22:38.960543+0000","last_unstale":"2024-09-10T09:22:40.765966+0000","last_undegraded":"2024-09-10T09:22:40.765966+0000","last_fullsized":"2024-09-10T09:22:40.765966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:07.172679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765791+0000","last_change":"2024-09-10T09:22:37.937400+0000","last_active":"2024-09-10T09:22:40.765791+0000","last_peered":"2024-09-10T09:22:40.765791+0000","last_clean":"2024-09-10T09:22:40.765791+0000","last_became_active":"2024-09-10T09:22:37.934936+0000","last_became_peered":"2024-09-10T09:22:37.934936+0000","last_unstale":"2024-09-10T09:22:40.765791+0000","last_undegraded":"2024-09-10T09:22:40.765791+0000","last_fullsized":"2024-09-10T09:22:40.765791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:14.717544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765375+0000","last_change":"2024-09-10T09:22:38.975581+0000","last_active":"2024-09-10T09:22:40.765375+0000","last_peered":"2024-09-10T09:22:40.765375+0000","last_clean":"2024-09-10T09:22:40.765375+0000","last_became_active":"2024-09-10T09:22:38.975251+0000","last_became_peered":"2024-09-10T09:22:38.975251+0000","last_unstale":"2024-09-10T09:22:40.765375+0000","last_undegraded":"2024-09-10T09:22:40.765375+0000","last_fullsized":"2024-09-10T09:22:40.765375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:38.287488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766352+0000","last_change":"2024-09-10T09:22:37.933756+0000","last_active":"2024-09-10T09:22:40.766352+0000","last_peered":"2024-09-10T09:22:40.766352+0000","last_clean":"2024-09-10T09:22:40.766352+0000","last_became_active":"2024-09-10T09:22:37.933486+0000","last_became_peered":"2024-09-10T09:22:37.933486+0000","last_unstale":"2024-09-10T09:22:40.766352+0000","last_undegraded":"2024-09-10T09:22:40.766352+0000","last_fullsized":"2024-09-10T09:22:40.766352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:19.576934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":665039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":74179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":74089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:22:43.287 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T09:22:43.288 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T09:22:43.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T09:22:43.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T09:22:43.288 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T09:22:43.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.425+0000 7f0f7f4f8640 1 Processor -- start 2024-09-10T09:22:43.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.425+0000 7f0f7f4f8640 1 -- start start 2024-09-10T09:22:43.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7f4f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f7815eac0 0x7f0f780cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7f4f8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f780ced90 0x7f0f780b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7f4f8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f780d26f0 con 0x7f0f780b61c0 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7f4f8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780d29d0 con 0x7f0f780ced90 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7f4f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780d2cb0 con 0x7f0f7815eac0 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7ca93640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f780ced90 0x7f0f780b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7da95640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f780b61c0 0x7f0f780d3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51566/0 (socket says 172.21.15.12:51566) 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7da95640 1 -- 172.21.15.12:0/2462442037 learned_addr learned my addr 172.21.15.12:0/2462442037 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7d294640 1 --2- 172.21.15.12:0/2462442037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f7815eac0 0x7f0f780cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7ca93640 1 -- 172.21.15.12:0/2462442037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f7815eac0 msgr2=0x7f0f780cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7ca93640 1 --2- 172.21.15.12:0/2462442037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f7815eac0 0x7f0f780cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7ca93640 1 -- 172.21.15.12:0/2462442037 >> v1:172.21.15.12:6789/0 conn(0x7f0f780b61c0 legacy=0x7f0f780d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.426+0000 7f0f7ca93640 1 -- 172.21.15.12:0/2462442037 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f780d2f90 con 0x7f0f780ced90 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.427+0000 7f0f7ca93640 1 --2- 172.21.15.12:0/2462442037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f780ced90 0x7f0f780b79b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097d0 tx=0x7f0f6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba5f9a64cbd7d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.427+0000 7f0f6ffff640 1 -- 172.21.15.12:0/2462442037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68037070 con 0x7f0f780ced90 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.427+0000 7f0f6ffff640 1 -- 172.21.15.12:0/2462442037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f68032440 con 0x7f0f780ced90 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.427+0000 7f0f6ffff640 1 -- 172.21.15.12:0/2462442037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68032810 con 0x7f0f780ced90 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/2462442037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f780ced90 msgr2=0x7f0f780b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/2462442037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f780ced90 0x7f0f780b79b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097d0 tx=0x7f0f6802a1c0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/2462442037 shutdown_connections 2024-09-10T09:22:43.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/2462442037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f780ced90 0x7f0f780b79b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/2462442037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f7815eac0 0x7f0f780cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/2462442037 >> 172.21.15.12:0/2462442037 conn(0x7f0f780d11c0 msgr2=0x7f0f780d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/2462442037 shutdown_connections 2024-09-10T09:22:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.428+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/2462442037 wait complete. 2024-09-10T09:22:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.429+0000 7f0f7f4f8640 1 Processor -- start 2024-09-10T09:22:43.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.429+0000 7f0f7f4f8640 1 -- start start 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7f4f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f780b61c0 0x7f0f781599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7f4f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f780ced90 0x7f0f78152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7f4f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 0x7f0f78158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7f4f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d2490 con 0x7f0f7815eac0 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7f4f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d2310 con 0x7f0f780ced90 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7f4f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780b6670 con 0x7f0f780b61c0 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 0x7f0f78158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 0x7f0f78158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45750/0 (socket says 172.21.15.12:45750) 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 -- 172.21.15.12:0/3097359451 learned_addr learned my addr 172.21.15.12:0/3097359451 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:43.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7d294640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f780b61c0 0x7f0f781599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7ca93640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f780ced90 0x7f0f78152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 -- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f780b61c0 msgr2=0x7f0f781599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f780b61c0 0x7f0f781599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 -- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f780ced90 msgr2=0x7f0f78152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f780ced90 0x7f0f78152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.430+0000 7f0f7da95640 1 -- 172.21.15.12:0/3097359451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f780c82f0 con 0x7f0f7815eac0 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.431+0000 7f0f7da95640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 0x7f0f78158c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000cbf0 tx=0x7f0f7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.431+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70017070 con 0x7f0f7815eac0 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.431+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7000ad40 con 0x7f0f7815eac0 2024-09-10T09:22:43.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.431+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7815c630 con 0x7f0f7815eac0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.431+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70012600 con 0x7f0f7815eac0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.431+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f78159f20 con 0x7f0f7815eac0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.432+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f780b69f0 con 0x7f0f7815eac0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.432+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f7001a070 con 0x7f0f7815eac0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.433+0000 7f0f6dffb640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0f5c06be30 0x7f0f5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.433+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f7008aa90 con 0x7f0f7815eac0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.433+0000 7f0f7d294640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0f5c06be30 0x7f0f5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.433+0000 7f0f7d294640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0f5c06be30 0x7f0f5c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0f740079a0 tx=0x7f0f74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.438+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f70058e80 con 0x7f0f7815eac0 2024-09-10T09:22:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.659+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0f780ba450 con 0x7f0f7815eac0 2024-09-10T09:22:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.662+0000 7f0f6dffb640 1 -- 172.21.15.12:0/3097359451 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172945 (secure 0 0 0) 0x7f0f7005d180 con 0x7f0f7815eac0 2024-09-10T09:22:43.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0f5c06be30 msgr2=0x7f0f5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0f5c06be30 0x7f0f5c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0f740079a0 tx=0x7f0f74008040 comp rx=0 tx=0).stop 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 msgr2=0x7f0f78158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 0x7f0f78158c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000cbf0 tx=0x7f0f7000a430 comp rx=0 tx=0).stop 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 shutdown_connections 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0f5c06be30 0x7f0f5c06e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7815eac0 0x7f0f78158c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f780ced90 0x7f0f78152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 --2- 172.21.15.12:0/3097359451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f780b61c0 0x7f0f781599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 >> 172.21.15.12:0/3097359451 conn(0x7f0f780d11c0 msgr2=0x7f0f780cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 shutdown_connections 2024-09-10T09:22:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.665+0000 7f0f7f4f8640 1 -- 172.21.15.12:0/3097359451 wait complete. 2024-09-10T09:22:43.677 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3276402792},{"type":"v1","addr":"172.21.15.100:6833","nonce":3276402792}]},"active_addr":"172.21.15.100:6833/3276402792","active_change":"2024-09-10T09:22:19.208692+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2824567996}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":289943908}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1852658990}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3493327657}]}]} 2024-09-10T09:22:43.681 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T09:22:43.681 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T09:22:43.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:43.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.782+0000 7fe54b326640 1 Processor -- start 2024-09-10T09:22:43.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.782+0000 7fe54b326640 1 -- start start 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe54b326640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe5440b8f90 0x7fe5440b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe54b326640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5440b7170 con 0x7fe54415ed20 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe54b326640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5440b7aa0 con 0x7fe54415e940 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe54b326640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe5440d3660 con 0x7fe5440b8f90 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe5488c1640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe54415ed20 0x7fe5440b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51572/0 (socket says 172.21.15.12:51572) 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe5488c1640 1 -- 172.21.15.12:0/1822071669 learned_addr learned my addr 172.21.15.12:0/1822071669 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe5498c3640 1 --2- 172.21.15.12:0/1822071669 >> v2:172.21.15.100:3300/0 conn(0x7fe5440b8f90 0x7fe5440b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe53bfff640 1 -- 172.21.15.12:0/1822071669 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517336160 0 0) 0x7fe534001110 con 0x7fe54415ed20 2024-09-10T09:22:43.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe53bfff640 1 -- 172.21.15.12:0/1822071669 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe530003520 con 0x7fe54415ed20 2024-09-10T09:22:43.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe5498c3640 1 -- 172.21.15.12:0/1822071669 >> v1:172.21.15.100:6789/0 conn(0x7fe54415e940 legacy=0x7fe5440d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe5498c3640 1 -- 172.21.15.12:0/1822071669 >> v1:172.21.15.12:6789/0 conn(0x7fe54415ed20 legacy=0x7fe5440b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.783+0000 7fe5498c3640 1 -- 172.21.15.12:0/1822071669 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440d3940 con 0x7fe5440b8f90 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.784+0000 7fe5498c3640 1 --2- 172.21.15.12:0/1822071669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5440b8f90 0x7fe5440b3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009d90 tx=0x7fe53c02a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcb1ce1987e07535 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.784+0000 7fe53bfff640 1 -- 172.21.15.12:0/1822071669 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c037070 con 0x7fe5440b8f90 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.784+0000 7fe53bfff640 1 -- 172.21.15.12:0/1822071669 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c007740 con 0x7fe5440b8f90 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.784+0000 7fe53bfff640 1 -- 172.21.15.12:0/1822071669 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007b10 con 0x7fe5440b8f90 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 -- 172.21.15.12:0/1822071669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5440b8f90 msgr2=0x7fe5440b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 --2- 172.21.15.12:0/1822071669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5440b8f90 0x7fe5440b3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009d90 tx=0x7fe53c02a780 comp rx=0 tx=0).stop 2024-09-10T09:22:43.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 -- 172.21.15.12:0/1822071669 shutdown_connections 2024-09-10T09:22:43.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 --2- 172.21.15.12:0/1822071669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5440b8f90 0x7fe5440b3930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 -- 172.21.15.12:0/1822071669 >> 172.21.15.12:0/1822071669 conn(0x7fe5440b6240 msgr2=0x7fe5440b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:43.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 -- 172.21.15.12:0/1822071669 shutdown_connections 2024-09-10T09:22:43.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.785+0000 7fe54b326640 1 -- 172.21.15.12:0/1822071669 wait complete. 2024-09-10T09:22:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 Processor -- start 2024-09-10T09:22:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 -- start start 2024-09-10T09:22:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5440b8f90 0x7fe54415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe54415e940 0x7fe5440cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 0x7fe5441f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5440d3310 con 0x7fe54415ed20 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5440d3f00 con 0x7fe54415e940 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe54b326640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe5440d1ef0 con 0x7fe5440b8f90 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 0x7fe5441f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 0x7fe5441f4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45764/0 (socket says 172.21.15.12:45764) 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 -- 172.21.15.12:0/2685151220 learned_addr learned my addr 172.21.15.12:0/2685151220 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5488c1640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe54415e940 0x7fe5440cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5490c2640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5440b8f90 0x7fe54415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 -- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5440b8f90 msgr2=0x7fe54415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5440b8f90 0x7fe54415d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 -- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe54415e940 msgr2=0x7fe5440cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe54415e940 0x7fe5440cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 -- 172.21.15.12:0/2685151220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440c9320 con 0x7fe54415ed20 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.787+0000 7fe5498c3640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 0x7fe5441f4a50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009d90 tx=0x7fe53c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.788+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c042020 con 0x7fe54415ed20 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.788+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c0327f0 con 0x7fe54415ed20 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.788+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5440c9600 con 0x7fe54415ed20 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.788+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c037040 con 0x7fe54415ed20 2024-09-10T09:22:43.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.788+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5440c9bc0 con 0x7fe54415ed20 2024-09-10T09:22:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.789+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5440cef90 con 0x7fe54415ed20 2024-09-10T09:22:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.789+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe53c045020 con 0x7fe54415ed20 2024-09-10T09:22:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.790+0000 7fe539ffb640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe52806be30 0x7fe52806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.790+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe53c0abd90 con 0x7fe54415ed20 2024-09-10T09:22:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.790+0000 7fe5490c2640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe52806be30 0x7fe52806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.790+0000 7fe5490c2640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe52806be30 0x7fe52806e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5441ea490 tx=0x7fe540009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.794+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe53c04c030 con 0x7fe54415ed20 2024-09-10T09:22:43.911 INFO:tasks.ceph.mds.d.smithi100.stderr:2024-09-10T09:22:43.910+0000 7fbd77ecf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T09:22:43.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.973+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe544161530 con 0x7fe54415ed20 2024-09-10T09:22:43.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.975+0000 7fe539ffb640 1 -- 172.21.15.12:0/2685151220 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fe53c07a180 con 0x7fe54415ed20 2024-09-10T09:22:43.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:43.976 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:43.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.976+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe52806be30 msgr2=0x7fe52806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.976+0000 7fe54b326640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe52806be30 0x7fe52806e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5441ea490 tx=0x7fe540009040 comp rx=0 tx=0).stop 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.976+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 msgr2=0x7fe5441f4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.976+0000 7fe54b326640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 0x7fe5441f4a50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009d90 tx=0x7fe53c004a40 comp rx=0 tx=0).stop 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 shutdown_connections 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe52806be30 0x7fe52806e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54415ed20 0x7fe5441f4a50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe54415e940 0x7fe5440cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 --2- 172.21.15.12:0/2685151220 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5440b8f90 0x7fe54415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 >> 172.21.15.12:0/2685151220 conn(0x7fe5440b6240 msgr2=0x7fe5440b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 shutdown_connections 2024-09-10T09:22:43.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:43.977+0000 7fe54b326640 1 -- 172.21.15.12:0/2685151220 wait complete. 2024-09-10T09:22:43.989 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T09:22:43.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:44.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.089+0000 7f8aeb9e4640 1 Processor -- start 2024-09-10T09:22:44.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.089+0000 7f8aeb9e4640 1 -- start start 2024-09-10T09:22:44.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8aeb9e4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ae415e940 0x7f8ae40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8aeb9e4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ae415ed20 0x7f8ae40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8aeb9e4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae40b7170 con 0x7f8ae40cef90 2024-09-10T09:22:44.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8aeb9e4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae40d1ae0 con 0x7f8ae415e940 2024-09-10T09:22:44.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8aeb9e4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae40b7aa0 con 0x7f8ae415ed20 2024-09-10T09:22:44.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8ae9780640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ae415e940 0x7f8ae40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8ae9f81640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8ae40cef90 0x7f8ae40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51586/0 (socket says 172.21.15.12:51586) 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8ae9f81640 1 -- 172.21.15.12:0/319292258 learned_addr learned my addr 172.21.15.12:0/319292258 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.090+0000 7f8ae8f7f640 1 --2- 172.21.15.12:0/319292258 >> v2:172.21.15.100:3300/0 conn(0x7f8ae415ed20 0x7f8ae40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ae9780640 1 -- 172.21.15.12:0/319292258 >> v2:172.21.15.100:3300/0 conn(0x7f8ae415ed20 msgr2=0x7f8ae40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ae9780640 1 --2- 172.21.15.12:0/319292258 >> v2:172.21.15.100:3300/0 conn(0x7f8ae415ed20 0x7f8ae40d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ae9780640 1 -- 172.21.15.12:0/319292258 >> v1:172.21.15.12:6789/0 conn(0x7f8ae40cef90 legacy=0x7f8ae40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ae9780640 1 -- 172.21.15.12:0/319292258 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae40d3660 con 0x7f8ae415e940 2024-09-10T09:22:44.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ad7fff640 1 -- 172.21.15.12:0/319292258 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196401698 0 0) 0x7f8adc001490 con 0x7f8ae40cef90 2024-09-10T09:22:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ae9780640 1 --2- 172.21.15.12:0/319292258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae40d1060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ae406e900 tx=0x7f8ad802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7235eb029b0cba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ad7fff640 1 -- 172.21.15.12:0/319292258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8037070 con 0x7f8ae415e940 2024-09-10T09:22:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ad7fff640 1 -- 172.21.15.12:0/319292258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad8032440 con 0x7f8ae415e940 2024-09-10T09:22:44.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.091+0000 7f8ad7fff640 1 -- 172.21.15.12:0/319292258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8032810 con 0x7f8ae415e940 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/319292258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 msgr2=0x7f8ae40d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/319292258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae40d1060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ae406e900 tx=0x7f8ad802a230 comp rx=0 tx=0).stop 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/319292258 shutdown_connections 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/319292258 >> v2:172.21.15.100:3300/0 conn(0x7f8ae415ed20 0x7f8ae40d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/319292258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae40d1060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/319292258 >> 172.21.15.12:0/319292258 conn(0x7f8ae40b6240 msgr2=0x7f8ae40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/319292258 shutdown_connections 2024-09-10T09:22:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.092+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/319292258 wait complete. 2024-09-10T09:22:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.093+0000 7f8aeb9e4640 1 Processor -- start 2024-09-10T09:22:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.093+0000 7f8aeb9e4640 1 -- start start 2024-09-10T09:22:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8aeb9e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ae40cef90 0x7f8ae414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8aeb9e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae4158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8aeb9e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ae415ed20 0x7f8ae40ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8aeb9e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40d3f00 con 0x7f8ae415e940 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8aeb9e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae40d3c20 con 0x7f8ae415ed20 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8aeb9e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae40d3310 con 0x7f8ae40cef90 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae4158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae4158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45778/0 (socket says 172.21.15.12:45778) 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 -- 172.21.15.12:0/1508485000 learned_addr learned my addr 172.21.15.12:0/1508485000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae9f81640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ae415ed20 0x7f8ae40ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae9780640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ae40cef90 0x7f8ae414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 -- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ae40cef90 msgr2=0x7f8ae414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ae40cef90 0x7f8ae414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 -- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ae415ed20 msgr2=0x7f8ae40ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ae415ed20 0x7f8ae40ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae8f7f640 1 -- 172.21.15.12:0/1508485000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae40cd450 con 0x7f8ae415e940 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.094+0000 7f8ae9780640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ae40cef90 0x7f8ae414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.095+0000 7f8ae8f7f640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae4158800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000d7d0 tx=0x7f8ae000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.095+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000b660 con 0x7f8ae415e940 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.095+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae0019070 con 0x7f8ae415e940 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.095+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae40cd730 con 0x7f8ae415e940 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.095+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000ba60 con 0x7f8ae415e940 2024-09-10T09:22:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.095+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae40cdcf0 con 0x7f8ae415e940 2024-09-10T09:22:44.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.096+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae40d0b80 con 0x7f8ae415e940 2024-09-10T09:22:44.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.096+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ae000bc00 con 0x7f8ae415e940 2024-09-10T09:22:44.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.097+0000 7f8ad5ffb640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ac806be30 0x7f8ac806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.097+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ae008b270 con 0x7f8ae415e940 2024-09-10T09:22:44.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.097+0000 7f8ae9780640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ac806be30 0x7f8ac806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.098+0000 7f8ae9780640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ac806be30 0x7f8ac806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8034000 tx=0x7f8ad802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.102+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ae40d0b80 con 0x7f8ae415e940 2024-09-10T09:22:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.279+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ae40d1ef0 con 0x7f8ae415e940 2024-09-10T09:22:44.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.280+0000 7f8ad5ffb640 1 -- 172.21.15.12:0/1508485000 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f8ae0059c20 con 0x7f8ae415e940 2024-09-10T09:22:44.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:44.282 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.282+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ac806be30 msgr2=0x7f8ac806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.282+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ac806be30 0x7f8ac806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8034000 tx=0x7f8ad802e000 comp rx=0 tx=0).stop 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.282+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 msgr2=0x7f8ae4158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.282+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae4158800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000d7d0 tx=0x7f8ae000dc90 comp rx=0 tx=0).stop 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 shutdown_connections 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ac806be30 0x7f8ac806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ae415ed20 0x7f8ae40ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ae415e940 0x7f8ae4158800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 --2- 172.21.15.12:0/1508485000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ae40cef90 0x7f8ae414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 >> 172.21.15.12:0/1508485000 conn(0x7f8ae40b6240 msgr2=0x7f8ae40b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 shutdown_connections 2024-09-10T09:22:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.284+0000 7f8aeb9e4640 1 -- 172.21.15.12:0/1508485000 wait complete. 2024-09-10T09:22:44.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T09:22:44.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T09:22:44.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T09:22:44.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T09:22:44.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T09:22:44.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T09:22:44.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T09:22:44.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T09:22:44.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.471+0000 7ff8d0a20640 1 Processor -- start 2024-09-10T09:22:44.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.471+0000 7fbecd42c640 1 Processor -- start 2024-09-10T09:22:44.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.471+0000 7fbecd42c640 1 -- start start 2024-09-10T09:22:44.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.471+0000 7fe0e18cf640 1 Processor -- start 2024-09-10T09:22:44.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.471+0000 7fe0e18cf640 1 -- start start 2024-09-10T09:22:44.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7ff8d0a20640 1 -- start start 2024-09-10T09:22:44.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbecd42c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbec8160750 0x7fbec806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbecd42c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbec80b1a70 0x7fbec8073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fe0e18cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0dc0b5670 0x7fe0dc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8d0a20640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc162ae0 0x7ff8cc073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8d0a20640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff8cc0d2f40 0x7ff8cc0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8d0a20640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8cc0d0f90 con 0x7ff8cc162ec0 2024-09-10T09:22:44.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8d0a20640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc0d0b00 con 0x7ff8cc0d2f40 2024-09-10T09:22:44.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8d0a20640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d1ee0 con 0x7ff8cc162ae0 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fe0e18cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0dc072140 0x7fe0dc06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fe0e18cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc072f10 con 0x7fe0dc06fc00 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fe0e18cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc15b7c0 con 0x7fe0dc072140 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fe0e18cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc161ea0 con 0x7fe0dc0b5670 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fe0e08cd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0dc0b5670 0x7fe0dc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fe0e10ce640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe0dc06fc00 0x7fe0dc0ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51592/0 (socket says 172.21.15.12:51592) 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2824766225 learned_addr learned my addr 172.21.15.12:0/2824766225 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514838520 0 0) 0x7fe0d4001490 con 0x7fe0dc06fc00 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c4003520 con 0x7fe0dc06fc00 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fe0dbfff640 1 --2- 172.21.15.12:0/2824766225 >> v2:172.21.15.100:3300/0 conn(0x7fe0dc072140 0x7fe0dc06f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2160714497 0 0) 0x7fe0c4003520 con 0x7fe0dc06fc00 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0dc0b5670 msgr2=0x7fe0dc15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0dc0b5670 0x7fe0dc15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 >> v2:172.21.15.100:3300/0 conn(0x7fe0dc072140 msgr2=0x7fe0dc06f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 --2- 172.21.15.12:0/2824766225 >> v2:172.21.15.100:3300/0 conn(0x7fe0dc072140 0x7fe0dc06f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc072950 con 0x7fe0dc06fc00 2024-09-10T09:22:44.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7f4f650cf640 1 Processor -- start 2024-09-10T09:22:44.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8caffd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff8cc162ec0 0x7ff8cc0d2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44898/0 (socket says 172.21.15.12:44898) 2024-09-10T09:22:44.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7ff8caffd640 1 -- 172.21.15.12:0/1686773756 learned_addr learned my addr 172.21.15.12:0/1686773756 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7ff8cbfff640 1 --2- 172.21.15.12:0/1686773756 >> v2:172.21.15.100:3300/0 conn(0x7ff8cc0d2f40 0x7ff8cc0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbec67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbec80b1a70 0x7fbec8073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbec67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbec80b1a70 0x7fbec8073be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45784/0 (socket says 172.21.15.12:45784) 2024-09-10T09:22:44.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbecd42c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec806e420 0x7fbec806e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbecd42c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbec806edd0 con 0x7fbec80b1a70 2024-09-10T09:22:44.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbecd42c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbec8074120 con 0x7fbec8160750 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbecd42c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80b6ff0 con 0x7fbec806e420 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.472+0000 7fbec67fc640 1 -- 172.21.15.12:0/1920500799 learned_addr learned my addr 172.21.15.12:0/1920500799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fbec67fc640 1 -- 172.21.15.12:0/1920500799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec806e420 msgr2=0x7fbec806e890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fbec67fc640 1 --2- 172.21.15.12:0/1920500799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec806e420 0x7fbec806e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fbec67fc640 1 -- 172.21.15.12:0/1920500799 >> v2:172.21.15.100:3300/0 conn(0x7fbec8160750 msgr2=0x7fbec806ccb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fbec67fc640 1 --2- 172.21.15.12:0/1920500799 >> v2:172.21.15.100:3300/0 conn(0x7fbec8160750 0x7fbec806ccb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.473+0000 7fbec67fc640 1 -- 172.21.15.12:0/1920500799 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80b72d0 con 0x7fbec80b1a70 2024-09-10T09:22:44.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7f22133fd640 1 Processor -- start 2024-09-10T09:22:44.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7f4f650cf640 1 -- start start 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fe0d4001bc0 con 0x7fe0dc06fc00 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 >> v1:172.21.15.12:6789/0 conn(0x7fe0dc06fc00 legacy=0x7fe0dc0ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c4004800 0x7fe0c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0c40051c0 0x7fe0c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc15b7c0 con 0x7fe0c40039b0 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc161ea0 con 0x7fe0c40051c0 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c400bf30 con 0x7fe0c4004800 2024-09-10T09:22:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0e10ce640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0c40051c0 0x7fe0c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0dbfff640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c4004800 0x7fe0c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fe0e08cd640 1 -- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c4004800 msgr2=0x7fe0c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c4004800 0x7fe0c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fe0e08cd640 1 -- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0c40051c0 msgr2=0x7fe0c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0c40051c0 0x7fe0c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fe0e08cd640 1 -- 172.21.15.12:0/2824766225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc072950 con 0x7fe0c40039b0 2024-09-10T09:22:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7ff8cbfff640 1 -- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc162ae0 msgr2=0x7ff8cc073970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T09:22:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7ff8cbfff640 1 --2- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc162ae0 0x7ff8cc073970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7ff8cbfff640 1 -- 172.21.15.12:0/1686773756 >> v1:172.21.15.100:6789/0 conn(0x7ff8cc162ec0 legacy=0x7ff8cc0d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7ff8cbfff640 1 -- 172.21.15.12:0/1686773756 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0734e0 con 0x7ff8cc0d2f40 2024-09-10T09:22:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fab3d61e640 1 Processor -- start 2024-09-10T09:22:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7fab3d61e640 1 -- start start 2024-09-10T09:22:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.474+0000 7f22133fd640 1 -- start start 2024-09-10T09:22:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f650cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f58008ff0 0x7f4f580eb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7ff8cbfff640 1 --2- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc0d2f40 0x7ff8cc0b5440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097a0 tx=0x7ff8bc02a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2cb2b31a5d8ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f650cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f580eb550 0x7f4f580eb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f650cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f58036010 con 0x7f4f58008c10 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f5ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4f58008c10 0x7f4f58035900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44910/0 (socket says 172.21.15.12:44910) 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f5ffff640 1 -- 172.21.15.12:0/3442129059 learned_addr learned my addr 172.21.15.12:0/3442129059 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4f58038570 con 0x7f4f58008ff0 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4f58038850 con 0x7f4f580eb550 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f5f7fe640 1 --2- 172.21.15.12:0/3442129059 >> v2:172.21.15.100:3300/0 conn(0x7f4f58008ff0 0x7f4f580eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f648ce640 1 --2- 172.21.15.12:0/3442129059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f580eb550 0x7f4f580eb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab3d61e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab38162930 0x7fab380b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/1686773756 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc037070 con 0x7ff8cc0d2f40 2024-09-10T09:22:44.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f22133fd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 0x7f220c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/1686773756 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc032440 con 0x7ff8cc0d2f40 2024-09-10T09:22:44.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7ff8ca7fc640 1 -- 172.21.15.12:0/1686773756 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc02ae60 con 0x7ff8cc0d2f40 2024-09-10T09:22:44.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f5effd640 1 -- 172.21.15.12:0/3442129059 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689070122 0 0) 0x7f4f58036010 con 0x7f4f58008c10 2024-09-10T09:22:44.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f5effd640 1 -- 172.21.15.12:0/3442129059 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f50003520 con 0x7f4f58008c10 2024-09-10T09:22:44.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab3d61e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab380cf680 0x7fab380b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab3d61e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380cfd60 con 0x7fab380b1f60 2024-09-10T09:22:44.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab3d61e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fab380b2910 con 0x7fab38162930 2024-09-10T09:22:44.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f22133fd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f220c0b1f60 0x7f220c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f22133fd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220c06d4c0 con 0x7f220c06cf70 2024-09-10T09:22:44.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f22133fd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f220c0b2910 con 0x7f220c0b1f60 2024-09-10T09:22:44.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f22133fd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f220c0b32d0 con 0x7f220c15a5c0 2024-09-10T09:22:44.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f648ce640 1 -- 172.21.15.12:0/3442129059 >> v2:172.21.15.100:3300/0 conn(0x7f4f58008ff0 msgr2=0x7f4f580eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab3d61e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab380d0040 con 0x7fab380cf680 2024-09-10T09:22:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab367fc640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fab380b1f60 0x7fab380cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44926/0 (socket says 172.21.15.12:44926) 2024-09-10T09:22:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab367fc640 1 -- 172.21.15.12:0/2579199165 learned_addr learned my addr 172.21.15.12:0/2579199165 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f648ce640 1 --2- 172.21.15.12:0/3442129059 >> v2:172.21.15.100:3300/0 conn(0x7f4f58008ff0 0x7f4f580eb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f648ce640 1 -- 172.21.15.12:0/3442129059 >> v1:172.21.15.100:6789/0 conn(0x7f4f58008c10 legacy=0x7f4f58035900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f648ce640 1 -- 172.21.15.12:0/3442129059 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f58038b30 con 0x7f4f580eb550 2024-09-10T09:22:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f4f5f7fe640 1 --2- 172.21.15.12:0/3442129059 >> v2:172.21.15.100:3300/0 conn(0x7f4f58008ff0 0x7f4f580eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:44.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b40d0 tx=0x7fe0c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7190e975ff24aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab36ffd640 1 --2- 172.21.15.12:0/2579199165 >> v2:172.21.15.12:3300/0 conn(0x7fab38162930 0x7fab380b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab377fe640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab380cf680 0x7fab380b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f2211199640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 0x7f220c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f2211199640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 0x7f220c15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34432/0 (socket says 172.21.15.12:34432) 2024-09-10T09:22:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7f2211199640 1 -- 172.21.15.12:0/3622716538 learned_addr learned my addr 172.21.15.12:0/3622716538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204134331 0 0) 0x7fab380cfd60 con 0x7fab380b1f60 2024-09-10T09:22:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.476+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab20003520 con 0x7fab380b1f60 2024-09-10T09:22:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0036070 con 0x7fe0c40039b0 2024-09-10T09:22:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0031400 con 0x7fe0c40039b0 2024-09-10T09:22:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fe0db7fe640 1 -- 172.21.15.12:0/2824766225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0009630 con 0x7fe0c40039b0 2024-09-10T09:22:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7f2211199640 1 -- 172.21.15.12:0/3622716538 >> v2:172.21.15.12:3300/0 conn(0x7f220c0b1f60 msgr2=0x7f220c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7f2211199640 1 --2- 172.21.15.12:0/3622716538 >> v2:172.21.15.12:3300/0 conn(0x7f220c0b1f60 0x7f220c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7f2211199640 1 -- 172.21.15.12:0/3622716538 >> v1:172.21.15.12:6789/0 conn(0x7f220c06cf70 legacy=0x7f220c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7f2211199640 1 -- 172.21.15.12:0/3622716538 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220c06d7a0 con 0x7f220c15a5c0 2024-09-10T09:22:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 -- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc0d2f40 msgr2=0x7ff8cc0b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 --2- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc0d2f40 0x7ff8cc0b5440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097a0 tx=0x7ff8bc02a150 comp rx=0 tx=0).stop 2024-09-10T09:22:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1786777364 0 0) 0x7fab20003520 con 0x7fab380b1f60 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab380cf680 msgr2=0x7fab380b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab380cf680 0x7fab380b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 >> v2:172.21.15.12:3300/0 conn(0x7fab38162930 msgr2=0x7fab380b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 --2- 172.21.15.12:0/2579199165 >> v2:172.21.15.12:3300/0 conn(0x7fab38162930 0x7fab380b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab380b3710 con 0x7fab380b1f60 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fab2c001670 con 0x7fab380b1f60 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 >> v1:172.21.15.100:6789/0 conn(0x7fab380b1f60 legacy=0x7fab380cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab200039b0 0x7fab20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab200051c0 0x7fab2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab380b2910 con 0x7fab200039b0 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab380d0040 con 0x7fab200051c0 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab2000bfe0 con 0x7fab20004800 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 -- 172.21.15.12:0/1686773756 shutdown_connections 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 --2- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc0d2f40 0x7ff8cc0b5440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 --2- 172.21.15.12:0/1686773756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc162ae0 0x7ff8cc073970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 -- 172.21.15.12:0/1686773756 >> 172.21.15.12:0/1686773756 conn(0x7ff8cc062a50 msgr2=0x7ff8cc062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab367fc640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 -- 172.21.15.12:0/1686773756 shutdown_connections 2024-09-10T09:22:44.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7ff8d0a20640 1 -- 172.21.15.12:0/1686773756 wait complete. 2024-09-10T09:22:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7f4f648ce640 1 --2- 172.21.15.12:0/3442129059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f580eb550 0x7f4f580eb980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f6006b750 tx=0x7f4f6006b1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec02503967ee213 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab377fe640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab200051c0 0x7fab2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab36ffd640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab200039b0 0x7fab20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7f4f5effd640 1 -- 172.21.15.12:0/3442129059 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b3070 con 0x7f4f580eb550 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab367fc640 1 -- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab200051c0 msgr2=0x7fab2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab367fc640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab200051c0 0x7fab2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab367fc640 1 -- 172.21.15.12:0/2579199165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab200039b0 msgr2=0x7fab20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab367fc640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab200039b0 0x7fab20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fab367fc640 1 -- 172.21.15.12:0/2579199165 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab380b3710 con 0x7fab20004800 2024-09-10T09:22:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f4f5effd640 1 -- 172.21.15.12:0/3442129059 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600a6e40 con 0x7f4f580eb550 2024-09-10T09:22:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f93619b7640 1 Processor -- start 2024-09-10T09:22:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f4f5effd640 1 -- 172.21.15.12:0/3442129059 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600ae640 con 0x7f4f580eb550 2024-09-10T09:22:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.477+0000 7fbec67fc640 1 --2- 172.21.15.12:0/1920500799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec8073be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbec80d3680 tx=0x7fbeb802a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca39c50a0528ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f2211199640 1 --2- 172.21.15.12:0/3622716538 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 0x7f220c15a9a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e50 tx=0x7f220402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b8aaad92bb77e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f93619b7640 1 -- start start 2024-09-10T09:22:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7fbec5ffb640 1 -- 172.21.15.12:0/1920500799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8036070 con 0x7fbec80b1a70 2024-09-10T09:22:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f220bfff640 1 -- 172.21.15.12:0/3622716538 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204036070 con 0x7f220c15a5c0 2024-09-10T09:22:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7fbec5ffb640 1 -- 172.21.15.12:0/1920500799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb8031600 con 0x7fbec80b1a70 2024-09-10T09:22:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f220bfff640 1 -- 172.21.15.12:0/3622716538 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204031600 con 0x7f220c15a5c0 2024-09-10T09:22:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7f220bfff640 1 -- 172.21.15.12:0/3622716538 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22040319d0 con 0x7f220c15a5c0 2024-09-10T09:22:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.478+0000 7fbec5ffb640 1 -- 172.21.15.12:0/1920500799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80319d0 con 0x7fbec80b1a70 2024-09-10T09:22:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f580eb550 msgr2=0x7f4f580eb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 --2- 172.21.15.12:0/3442129059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f580eb550 0x7f4f580eb980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f6006b750 tx=0x7f4f6006b1c0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2824766225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c40039b0 msgr2=0x7fe0c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e18cf640 1 --2- 172.21.15.12:0/2824766225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b40d0 tx=0x7fe0c4005830 comp rx=0 tx=0).stop 2024-09-10T09:22:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2824766225 reap_dead start 2024-09-10T09:22:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2824766225 shutdown_connections 2024-09-10T09:22:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2824766225 >> 172.21.15.12:0/2824766225 conn(0x7fe0dc0d1310 msgr2=0x7fe0dc0d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7ff8d0a20640 1 Processor -- start 2024-09-10T09:22:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2824766225 shutdown_connections 2024-09-10T09:22:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2824766225 wait complete. 2024-09-10T09:22:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 shutdown_connections 2024-09-10T09:22:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fab367fc640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab20004c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c260 tx=0x7fab20005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f8d1470f079ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f22133fd640 1 -- 172.21.15.12:0/3622716538 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 msgr2=0x7f220c15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f22133fd640 1 --2- 172.21.15.12:0/3622716538 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 0x7f220c15a9a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e50 tx=0x7f220402a5b0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f93619b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c06c2b0 0x7f935c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7ff8d0a20640 1 -- start start 2024-09-10T09:22:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f93619b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f935c0af900 0x7f935c0cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f93619b7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f935c0cf3a0 con 0x7f935c162930 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f93619b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f935c0b4870 con 0x7f935c0af900 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f93619b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f935c0afd70 con 0x7f935c06c2b0 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fbecd42c640 1 -- 172.21.15.12:0/1920500799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 msgr2=0x7fbec8073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7fbecd42c640 1 --2- 172.21.15.12:0/1920500799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec8073be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbec80d3680 tx=0x7fbeb802a470 comp rx=0 tx=0).stop 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 --2- 172.21.15.12:0/3442129059 >> v2:172.21.15.100:3300/0 conn(0x7f4f58008ff0 0x7f4f580eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 --2- 172.21.15.12:0/3442129059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f580eb550 0x7f4f580eb980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 >> 172.21.15.12:0/3442129059 conn(0x7f4f5801fb30 msgr2=0x7f4f580567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f22133fd640 1 -- 172.21.15.12:0/3622716538 shutdown_connections 2024-09-10T09:22:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f22133fd640 1 --2- 172.21.15.12:0/3622716538 >> v2:172.21.15.12:3300/0 conn(0x7f220c0b1f60 0x7f220c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f22133fd640 1 --2- 172.21.15.12:0/3622716538 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c15a5c0 0x7f220c15a9a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f22133fd640 1 -- 172.21.15.12:0/3622716538 >> 172.21.15.12:0/3622716538 conn(0x7f220c06bba0 msgr2=0x7f220c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.480+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 shutdown_connections 2024-09-10T09:22:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 -- 172.21.15.12:0/1920500799 shutdown_connections 2024-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 --2- 172.21.15.12:0/1920500799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec806e420 0x7fbec806e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 --2- 172.21.15.12:0/1920500799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec8073be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 --2- 172.21.15.12:0/1920500799 >> v2:172.21.15.100:3300/0 conn(0x7fbec8160750 0x7fbec806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 -- 172.21.15.12:0/1920500799 >> 172.21.15.12:0/1920500799 conn(0x7fbec8062630 msgr2=0x7fbec8062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f22133fd640 1 -- 172.21.15.12:0/3622716538 shutdown_connections 2024-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f22133fd640 1 -- 172.21.15.12:0/3622716538 wait complete. 2024-09-10T09:22:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935affd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f935c162930 0x7f935c06bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44936/0 (socket says 172.21.15.12:44936) 2024-09-10T09:22:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f935c0af900 0x7f935c0cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f935c0af900 0x7f935c0cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44218/0 (socket says 172.21.15.12:44218) 2024-09-10T09:22:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 -- 172.21.15.12:0/2660578937 learned_addr learned my addr 172.21.15.12:0/2660578937 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935a7fc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c06c2b0 0x7f935c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 -- 172.21.15.12:0/1920500799 shutdown_connections 2024-09-10T09:22:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c036070 con 0x7fab20004800 2024-09-10T09:22:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c005af0 con 0x7fab20004800 2024-09-10T09:22:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fe0e18cf640 1 Processor -- start 2024-09-10T09:22:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fe0e18cf640 1 -- start start 2024-09-10T09:22:44.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fbecd42c640 1 -- 172.21.15.12:0/1920500799 wait complete. 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f4f650cf640 1 -- 172.21.15.12:0/3442129059 wait complete. 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fab35ffb640 1 -- 172.21.15.12:0/2579199165 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c007d70 con 0x7fab20004800 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fab3d61e640 1 -- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 msgr2=0x7fab20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fab3d61e640 1 --2- 172.21.15.12:0/2579199165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab20004c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c260 tx=0x7fab20005830 comp rx=0 tx=0).stop 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7fab377fe640 1 -- 172.21.15.12:0/2579199165 reap_dead start 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 -- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c06c2b0 msgr2=0x7f935c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 --2- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c06c2b0 0x7f935c0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 -- 172.21.15.12:0/2660578937 >> v1:172.21.15.100:6789/0 conn(0x7f935c162930 legacy=0x7f935c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f935b7fe640 1 -- 172.21.15.12:0/2660578937 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c0b4010 con 0x7f935c0af900 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8d0a20640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc0d2f40 0x7ff8cc165c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8d0a20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8cc162ae0 0x7ff8cc1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8caffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8cc162ae0 0x7ff8cc1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8caffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8cc162ae0 0x7ff8cc1f7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45816/0 (socket says 172.21.15.12:45816) 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8caffd640 1 -- 172.21.15.12:0/3997102125 learned_addr learned my addr 172.21.15.12:0/3997102125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8d0a20640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc162ec0 0x7ff8cc0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8d0a20640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc073eb0 con 0x7ff8cc162ae0 2024-09-10T09:22:44.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8d0a20640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d0790 con 0x7ff8cc162ec0 2024-09-10T09:22:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7ff8d0a20640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc074030 con 0x7ff8cc0d2f40 2024-09-10T09:22:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f21e512b640 1 Processor -- start 2024-09-10T09:22:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f4f650cf640 1 Processor -- start 2024-09-10T09:22:44.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f22133fd640 1 Processor -- start 2024-09-10T09:22:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.481+0000 7f21e512b640 1 -- start start 2024-09-10T09:22:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21e512b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 0x7f21d8053f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21e512b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21d804eb50 0x7f21d801d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21e512b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d8052320 con 0x7f21d8005a50 2024-09-10T09:22:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21e512b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f21d80520d0 con 0x7f21d804eb50 2024-09-10T09:22:44.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21e512b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f21d8006c70 con 0x7f21d80e7110 2024-09-10T09:22:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f22133fd640 1 -- start start 2024-09-10T09:22:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fbecd42c640 1 Processor -- start 2024-09-10T09:22:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f4f650cf640 1 -- start start 2024-09-10T09:22:44.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f935b7fe640 1 --2- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c0af900 0x7f935c0cf860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9354009e50 tx=0x7f935402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769db992ff8f9f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 0x7f21d8053f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 0x7f21d8053f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34460/0 (socket says 172.21.15.12:34460) 2024-09-10T09:22:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21df7fe640 1 -- 172.21.15.12:0/587415008 learned_addr learned my addr 172.21.15.12:0/587415008 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21e492a640 1 --2- 172.21.15.12:0/587415008 >> v2:172.21.15.12:3300/0 conn(0x7f21d804eb50 0x7f21d801d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fe0e18cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c40039b0 0x7fe0dc1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fe0e18cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc15d4a0 0x7fe0dc15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fab3d61e640 1 -- 172.21.15.12:0/2579199165 shutdown_connections 2024-09-10T09:22:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fab3d61e640 1 -- 172.21.15.12:0/2579199165 >> 172.21.15.12:0/2579199165 conn(0x7fab3806bba0 msgr2=0x7fab3806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f21df7fe640 1 -- 172.21.15.12:0/587415008 >> v2:172.21.15.12:3300/0 conn(0x7f21d804eb50 msgr2=0x7f21d801d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fe0e18cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0dc0cf5c0 0x7fe0dc0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fe0e18cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0ce200 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fe0e18cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0cdf20 con 0x7fe0dc15d4a0 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fe0e18cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc072580 con 0x7fe0c40039b0 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7f9359ffb640 1 -- 172.21.15.12:0/2660578937 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354036070 con 0x7f935c0af900 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0dc0cf5c0 0x7fe0dc0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0dc0cf5c0 0x7fe0dc0cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45828/0 (socket says 172.21.15.12:45828) 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2791635890 learned_addr learned my addr 172.21.15.12:0/2791635890 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c40039b0 0x7fe0dc1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f9359ffb640 1 -- 172.21.15.12:0/2660578937 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9354031600 con 0x7f935c0af900 2024-09-10T09:22:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21deffd640 1 -- 172.21.15.12:0/587415008 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647334753 0 0) 0x7f21d8052320 con 0x7f21d8005a50 2024-09-10T09:22:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7ff8cb7fe640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc0d2f40 0x7ff8cc165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7ff8caffd640 1 -- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc0d2f40 msgr2=0x7ff8cc165c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7ff8caffd640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff8cc0d2f40 0x7ff8cc165c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7ff8caffd640 1 -- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc162ec0 msgr2=0x7ff8cc0ac6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7ff8caffd640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8cc162ec0 0x7ff8cc0ac6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7ff8caffd640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc1f9380 con 0x7ff8cc162ae0 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0dbfff640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc15d4a0 0x7fe0dc15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c40039b0 msgr2=0x7fe0dc1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0c40039b0 0x7fe0dc1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc15d4a0 msgr2=0x7fe0dc15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc15d4a0 0x7fe0dc15d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2791635890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc14dac0 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f22133fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f220c06cf70 0x7f220c13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f22133fd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c0b1f60 0x7f220c1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e10ce640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0dc0cf5c0 0x7fe0dc0cfa40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b5df0 tx=0x7fe0d4007060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f22133fd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f220c15a5c0 0x7f220c148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f650cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f58008c10 0x7f4f58186470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f22133fd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f220c06c690 con 0x7f220c15a5c0 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f22133fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f220c06dd60 con 0x7f220c06cf70 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f22133fd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f220c06c810 con 0x7f220c0b1f60 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f220c15a5c0 0x7f220c148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.483+0000 7fbecd42c640 1 -- start start 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fbecd42c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec806e420 0x7fbec8158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fbecd42c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 -- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c0af900 msgr2=0x7f935c0cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4007930 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f220c15a5c0 0x7f220c148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45834/0 (socket says 172.21.15.12:45834) 2024-09-10T09:22:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 -- 172.21.15.12:0/2922107018 learned_addr learned my addr 172.21.15.12:0/2922107018 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f2210998640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c0b1f60 0x7f220c1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f9359ffb640 1 -- 172.21.15.12:0/2660578937 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354036070 con 0x7f935c0af900 2024-09-10T09:22:44.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 --2- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c0af900 0x7f935c0cf860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9354009e50 tx=0x7f935402a710 comp rx=0 tx=0).stop 2024-09-10T09:22:44.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21df7fe640 1 --2- 172.21.15.12:0/587415008 >> v2:172.21.15.12:3300/0 conn(0x7f21d804eb50 0x7f21d801d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21df7fe640 1 -- 172.21.15.12:0/587415008 >> v1:172.21.15.12:6789/0 conn(0x7f21d8005a50 legacy=0x7f21d8005e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21df7fe640 1 -- 172.21.15.12:0/587415008 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d8006f50 con 0x7f21d80e7110 2024-09-10T09:22:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d4018070 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4007ad0 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f650cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f58008ff0 0x7f4f581880b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21e492a640 1 --2- 172.21.15.12:0/587415008 >> v2:172.21.15.12:3300/0 conn(0x7f21d804eb50 0x7f21d801d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:44.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 -- 172.21.15.12:0/2660578937 shutdown_connections 2024-09-10T09:22:44.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc14dda0 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 --2- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c0af900 0x7f935c0cf860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f58008c10 0x7f4f58186470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f58008c10 0x7f4f58186470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34496/0 (socket says 172.21.15.12:34496) 2024-09-10T09:22:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f5ffff640 1 -- 172.21.15.12:0/849900095 learned_addr learned my addr 172.21.15.12:0/849900095 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 --2- 172.21.15.12:0/2660578937 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c06c2b0 0x7f935c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 -- 172.21.15.12:0/2660578937 >> 172.21.15.12:0/2660578937 conn(0x7f935c062cc0 msgr2=0x7f935c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f650cf640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f580eb550 0x7f4f580049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc15cca0 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fbec67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fbec67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec81585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45848/0 (socket says 172.21.15.12:45848) 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec67fc640 1 -- 172.21.15.12:0/3061751709 learned_addr learned my addr 172.21.15.12:0/3061751709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbecd42c640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec8160750 0x7fbec8200a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80b6ce0 con 0x7fbec80b1a70 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80b7890 con 0x7fbec806e420 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbec81633a0 con 0x7fbec8160750 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f5f7fe640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f58008ff0 0x7f4f581880b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58005e40 con 0x7f4f580eb550 2024-09-10T09:22:44.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58038220 con 0x7f4f58008ff0 2024-09-10T09:22:44.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f648ce640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f580eb550 0x7f4f580049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4f58005fc0 con 0x7f4f58008c10 2024-09-10T09:22:44.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7fab3d61e640 1 -- 172.21.15.12:0/2579199165 shutdown_connections 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f2211199640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f220c06cf70 0x7f220c13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 -- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c0b1f60 msgr2=0x7f220c1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f220c0b1f60 0x7f220c1488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 -- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f220c06cf70 msgr2=0x7f220c13cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f220c06cf70 0x7f220c13cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 -- 172.21.15.12:0/2922107018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220c1f17b0 con 0x7f220c15a5c0 2024-09-10T09:22:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f221199a640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f220c15a5c0 0x7f220c148de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00b450 tx=0x7f21fc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 -- 172.21.15.12:0/2660578937 shutdown_connections 2024-09-10T09:22:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f93619b7640 1 -- 172.21.15.12:0/2660578937 wait complete. 2024-09-10T09:22:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7ff8caffd640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8cc162ae0 0x7ff8cc1f7b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000b7b0 tx=0x7ff8c000bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21df7fe640 1 --2- 172.21.15.12:0/587415008 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 0x7f21d8053f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009870 tx=0x7f21cc02a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53cd6a4856f0025 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21deffd640 1 -- 172.21.15.12:0/587415008 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc037070 con 0x7f21d80e7110 2024-09-10T09:22:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.484+0000 7f21deffd640 1 -- 172.21.15.12:0/587415008 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21cc032640 con 0x7f21d80e7110 2024-09-10T09:22:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec6ffd640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec806e420 0x7fbec8158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f4f5ffff640 1 -- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f58008ff0 msgr2=0x7f4f581880b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f4f5ffff640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f58008ff0 0x7f4f581880b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f4f5ffff640 1 -- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f580eb550 msgr2=0x7f4f580049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f4f5ffff640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f580eb550 0x7f4f580049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f4f5ffff640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f58023390 con 0x7f4f58008c10 2024-09-10T09:22:44.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f4f5f7fe640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f58008ff0 0x7f4f581880b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:44.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec77fe640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec8160750 0x7fbec8200a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0dc06f6c0 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fab3d61e640 1 -- 172.21.15.12:0/2579199165 wait complete. 2024-09-10T09:22:44.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec77fe640 1 -- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec806e420 msgr2=0x7fbec8158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec77fe640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbec806e420 0x7fbec8158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec77fe640 1 -- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 msgr2=0x7fbec81585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec77fe640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec80b1a70 0x7fbec81585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7fbec77fe640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec815ade0 con 0x7fbec8160750 2024-09-10T09:22:44.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.485+0000 7f21deffd640 1 -- 172.21.15.12:0/587415008 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc02ae60 con 0x7f21d80e7110 2024-09-10T09:22:44.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f4f5ffff640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f58008c10 0x7f4f58186470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00c700 tx=0x7f4f4c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc015020 con 0x7f220c15a5c0 2024-09-10T09:22:44.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7fbec77fe640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec8160750 0x7fbec8200a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbec000be00 tx=0x7fbec000bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21fc011890 con 0x7f220c15a5c0 2024-09-10T09:22:44.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f22133fd640 1 -- 172.21.15.12:0/2922107018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220c1f1a90 con 0x7f220c15a5c0 2024-09-10T09:22:44.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0d4013630 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7fab3d61e640 1 Processor -- start 2024-09-10T09:22:44.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f22133fd640 1 -- 172.21.15.12:0/2922107018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220c1f2050 con 0x7f220c15a5c0 2024-09-10T09:22:44.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f93619b7640 1 Processor -- start 2024-09-10T09:22:44.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f93619b7640 1 -- start start 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f21e512b640 1 -- 172.21.15.12:0/587415008 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 msgr2=0x7f21d8053f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f21e512b640 1 --2- 172.21.15.12:0/587415008 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 0x7f21d8053f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009870 tx=0x7f21cc02a310 comp rx=0 tx=0).stop 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f21e512b640 1 -- 172.21.15.12:0/587415008 shutdown_connections 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f21e512b640 1 --2- 172.21.15.12:0/587415008 >> v2:172.21.15.12:3300/0 conn(0x7f21d804eb50 0x7f21d801d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f21e512b640 1 --2- 172.21.15.12:0/587415008 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80e7110 0x7f21d8053f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f21e512b640 1 -- 172.21.15.12:0/587415008 >> 172.21.15.12:0/587415008 conn(0x7f21d8036080 msgr2=0x7f21d8036490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc015020 con 0x7f220c15a5c0 2024-09-10T09:22:44.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c017070 con 0x7f4f58008c10 2024-09-10T09:22:44.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c007270 con 0x7f4f58008c10 2024-09-10T09:22:44.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0057a0 con 0x7f4f58008c10 2024-09-10T09:22:44.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f58023670 con 0x7f4f58008c10 2024-09-10T09:22:44.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f220c1f1560 con 0x7f220c15a5c0 2024-09-10T09:22:44.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7fe0d97fa640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0c806be60 0x7fe0c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f581885f0 con 0x7f4f58008c10 2024-09-10T09:22:44.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe0d408b580 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fe0d97fa640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fe0c8074080 0x7fe0c80764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 --> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0d4020e50 con 0x7fe0c8074080 2024-09-10T09:22:44.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f21e512b640 1 -- 172.21.15.12:0/587415008 shutdown_connections 2024-09-10T09:22:44.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f21e512b640 1 -- 172.21.15.12:0/587415008 wait complete. 2024-09-10T09:22:44.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0d4092050 con 0x7fe0dc0cf5c0 2024-09-10T09:22:44.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f93619b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c06c2b0 0x7f935c071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7fab3d61e640 1 -- start start 2024-09-10T09:22:44.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab3d61e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab3815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab3d61e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3815b3c0 0x7fab3815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f93619b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c0af900 0x7f935c071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f93619b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c162930 0x7f935c1f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f93619b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f935c162d10 con 0x7f935c162930 2024-09-10T09:22:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab36ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab3815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab36ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab3815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34508/0 (socket says 172.21.15.12:34508) 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f93619b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f935c0b4590 con 0x7f935c06c2b0 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f93619b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f935c0cde00 con 0x7f935c0af900 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0019070 con 0x7ff8cc162ae0 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c000c740 con 0x7ff8cc162ae0 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.486+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000cb30 con 0x7ff8cc162ae0 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7ff8d0a20640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc0aa960 con 0x7ff8cc162ae0 2024-09-10T09:22:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7ff8d0a20640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc0aaf20 con 0x7ff8cc162ae0 2024-09-10T09:22:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8cc0ab5d0 con 0x7ff8cc162ae0 2024-09-10T09:22:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0019070 con 0x7fbec8160750 2024-09-10T09:22:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.488+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0014440 con 0x7fbec8160750 2024-09-10T09:22:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0014890 con 0x7fbec8160750 2024-09-10T09:22:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7f935affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c06c2b0 0x7f935c071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec8201900 con 0x7fbec8160750 2024-09-10T09:22:44.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0c806be60 0x7fe0c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec8201ec0 con 0x7fbec8160750 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab3d61e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab381fbbc0 0x7fab381fc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab3d61e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab380b4730 con 0x7fab3815b3c0 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab3d61e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab380cfb10 con 0x7fab381fbbc0 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab3d61e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab380b3cd0 con 0x7fab20004800 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab36ffd640 1 -- 172.21.15.12:0/1733640241 learned_addr learned my addr 172.21.15.12:0/1733640241 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7fab367fc640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3815b3c0 0x7fab3815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7f935b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c162930 0x7f935c1f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fab377fe640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab381fbbc0 0x7fab381fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fe0dbfff640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fe0c8074080 0x7fe0c80764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7f935b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c162930 0x7f935c1f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45872/0 (socket says 172.21.15.12:45872) 2024-09-10T09:22:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7f935b7fe640 1 -- 172.21.15.12:0/2923049067 learned_addr learned my addr 172.21.15.12:0/2923049067 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.489+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f580eb010 con 0x7f4f58008c10 2024-09-10T09:22:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fab36ffd640 1 -- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab381fbbc0 msgr2=0x7fab381fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fab36ffd640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab381fbbc0 0x7fab381fc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fab36ffd640 1 -- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3815b3c0 msgr2=0x7fab3815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fab36ffd640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3815b3c0 0x7fab3815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fab36ffd640 1 -- 172.21.15.12:0/1733640241 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3815f300 con 0x7fab20004800 2024-09-10T09:22:44.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.490+0000 7fe0e08cd640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0c806be60 0x7fe0c806e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b40d0 tx=0x7fe0d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7f935a7fc640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c0af900 0x7f935c071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21fc018020 con 0x7f220c15a5c0 2024-09-10T09:22:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f4c01a070 con 0x7f4f58008c10 2024-09-10T09:22:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7f21e512b640 1 Processor -- start 2024-09-10T09:22:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7f21e512b640 1 -- start start 2024-09-10T09:22:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935a7fc640 1 -- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c06c2b0 msgr2=0x7f935c071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935a7fc640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f935c06c2b0 0x7f935c071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7fe0dbfff640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fe0c8074080 0x7fe0c80764a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f4f5cff9640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4f4406bf00 0x7f4f4406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f4c08a1c0 con 0x7f4f58008c10 2024-09-10T09:22:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f4f5cff9640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7f4f44074120 0x7f4f44076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f4c020e50 con 0x7f4f44074120 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4f4c091050 con 0x7f4f58008c10 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7fab36ffd640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab3815a840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab28009fd0 tx=0x7fab28011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28015870 con 0x7fab20004800 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab28015a10 con 0x7fab20004800 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28015e00 con 0x7fab20004800 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab381eaf40 con 0x7fab20004800 2024-09-10T09:22:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3815cb30 con 0x7fab20004800 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.491+0000 7f2209ffb640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21f806c230 0x7f21f806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21fc011690 con 0x7f220c15a5c0 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f2209ffb640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7f21f8074f60 0x7f21f8077400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 --> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21f8077ad0 con 0x7f21f8074f60 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f21fc055d10 con 0x7f220c15a5c0 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935a7fc640 1 -- 172.21.15.12:0/2923049067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c162930 msgr2=0x7f935c1f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935a7fc640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c162930 0x7f935c1f8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935a7fc640 1 -- 172.21.15.12:0/2923049067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c072920 con 0x7f935c0af900 2024-09-10T09:22:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935b7fe640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935c162930 0x7f935c1f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7f935a7fc640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c0af900 0x7f935c071bb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f934800e850 tx=0x7f934800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348017070 con 0x7f935c0af900 2024-09-10T09:22:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbec001c070 con 0x7fbec8160750 2024-09-10T09:22:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934800c940 con 0x7f935c0af900 2024-09-10T09:22:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f4f5f7fe640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4f4406bf00 0x7f4f4406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f2211199640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21f806c230 0x7f21f806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c1f9950 con 0x7f935c0af900 2024-09-10T09:22:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934800cd10 con 0x7f935c0af900 2024-09-10T09:22:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab380cfcc0 con 0x7fab20004800 2024-09-10T09:22:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f21e512b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d8005a50 0x7f21d804df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f4f5f7fe640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4f4406bf00 0x7f4f4406e3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f5804c180 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f21e512b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d804eb50 0x7f21d817cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f21e512b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80e7110 0x7f21d80373c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8c001c070 con 0x7ff8cc162ae0 2024-09-10T09:22:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f4f648ce640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7f4f44074120 0x7f4f44076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f21dffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d8005a50 0x7f21d804df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f21dffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d8005a50 0x7f21d804df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34524/0 (socket says 172.21.15.12:34524) 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7f21dffff640 1 -- 172.21.15.12:0/3444588275 learned_addr learned my addr 172.21.15.12:0/3444588275 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f21d8047b40 con 0x7f21d804eb50 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21df7fe640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d804eb50 0x7f21d817cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f21d8053a00 con 0x7f21d80e7110 2024-09-10T09:22:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8b3fff640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff8b806bf00 0x7ff8b806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21e492a640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80e7110 0x7f21d80373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f21d8047cc0 con 0x7f21d8005a50 2024-09-10T09:22:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1f9bf0 con 0x7f935c0af900 2024-09-10T09:22:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff8c008aac0 con 0x7ff8cc162ae0 2024-09-10T09:22:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f2210998640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7f21f8074f60 0x7f21f8077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8b3fff640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7ff8b8074120 0x7ff8b8076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8b8076bf0 con 0x7ff8b8074120 2024-09-10T09:22:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff8c008aeb0 con 0x7ff8cc162ae0 2024-09-10T09:22:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21dffff640 1 -- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80e7110 msgr2=0x7f21d80373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.492+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbec806e890 con 0x7fbec8160750 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7fbeaf7fe640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbeb406be80 0x7fbeb406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbec0055610 con 0x7fbec8160750 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7fbeaf7fe640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fbeb4074020 0x7fbeb4076440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbec0021e50 con 0x7fbeb4074020 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.493+0000 7fbec67fc640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fbeb4074020 0x7fbeb4076440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7fbec67fc640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fbeb4074020 0x7fbeb4076440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbec0055240 con 0x7fbec8160750 2024-09-10T09:22:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21dffff640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80e7110 0x7f21d80373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21dffff640 1 -- 172.21.15.12:0/3444588275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d804eb50 msgr2=0x7f21d817cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab28005990 con 0x7fab20004800 2024-09-10T09:22:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f4f648ce640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7f4f44074120 0x7f4f44076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21dffff640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d804eb50 0x7f21d817cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21dffff640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d803a440 con 0x7f21d8005a50 2024-09-10T09:22:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21e492a640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80e7110 0x7f21d80373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7f21dffff640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d8005a50 0x7f21d804df70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c410 tx=0x7f21d400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7fbec6ffd640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbeb406be80 0x7fbeb406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8cb7fe640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff8b806bf00 0x7ff8b806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.494+0000 7ff8cbfff640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7ff8b8074120 0x7ff8b8076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== osd.0 v2:172.21.15.12:6808/902038076 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0d4020e50 con 0x7fe0c8074080 2024-09-10T09:22:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f935c0cd750 con 0x7f935c0af900 2024-09-10T09:22:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4017070 con 0x7f21d8005a50 2024-09-10T09:22:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d40035f0 con 0x7f21d8005a50 2024-09-10T09:22:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fab1f7fe640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab2406bf00 0x7fab2406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4003a20 con 0x7f21d8005a50 2024-09-10T09:22:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== osd.1 v2:172.21.15.12:6811/3866682510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbec0021e50 con 0x7fbeb4074020 2024-09-10T09:22:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7ff8cb7fe640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff8b806bf00 0x7ff8b806e3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009f60 tx=0x7ff8c40094f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d8039680 con 0x7f21d8005a50 2024-09-10T09:22:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7ff8cbfff640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7ff8b8074120 0x7ff8b8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab2808c2c0 con 0x7fab20004800 2024-09-10T09:22:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fab1f7fe640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7fab24074120 0x7fab24076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 --> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab28027e50 con 0x7fab24074120 2024-09-10T09:22:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fab2808c6b0 con 0x7fab20004800 2024-09-10T09:22:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.495+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d8039c40 con 0x7f21d8005a50 2024-09-10T09:22:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7f2210998640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7f21f8074f60 0x7f21f8077400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7fab377fe640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7fab24074120 0x7fab24076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7fbec6ffd640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbeb406be80 0x7fbeb406e340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbebc006fd0 tx=0x7fbebc009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== osd.2 v2:172.21.15.12:6800/2895280715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f4c020e50 con 0x7f4f44074120 2024-09-10T09:22:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7f2211199640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21f806c230 0x7f21f806e6f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2204033000 tx=0x7f2204009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7fab367fc640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab2406bf00 0x7fab2406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f934801a070 con 0x7f935c0af900 2024-09-10T09:22:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.496+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== osd.6 v2:172.21.15.100:6800/2090972208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8b8076bf0 con 0x7ff8b8074120 2024-09-10T09:22:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.497+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21c0001030 con 0x7f21d8005a50 2024-09-10T09:22:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.497+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== osd.4 v2:172.21.15.100:6816/3211705705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21f8077ad0 con 0x7f21f8074f60 2024-09-10T09:22:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.497+0000 7f9353fff640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f934406bf00 0x7f934406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.497+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21d401a070 con 0x7f21d8005a50 2024-09-10T09:22:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.497+0000 7f935affd640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f934406bf00 0x7f934406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.497+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f934808b0d0 con 0x7f935c0af900 2024-09-10T09:22:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f935affd640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f934406bf00 0x7f934406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f934c000f60 tx=0x7f934c000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21dcff9640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21c406bf00 0x7f21c406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f9353fff640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7f9344074120 0x7f9344076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7fab367fc640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab2406bf00 0x7fab2406e3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab2c033000 tx=0x7fab2c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21d408a220 con 0x7f21d8005a50 2024-09-10T09:22:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21df7fe640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21c406bf00 0x7f21c406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21dcff9640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7f21c4074120 0x7f21c4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 --> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9344076bf0 con 0x7f9344074120 2024-09-10T09:22:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21d4011e50 con 0x7f21c4074120 2024-09-10T09:22:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f21d4091050 con 0x7f21d8005a50 2024-09-10T09:22:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f935b7fe640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7f9344074120 0x7f9344076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f21e492a640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7f21c4074120 0x7f21c4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.498+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f934808b4c0 con 0x7f935c0af900 2024-09-10T09:22:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.499+0000 7f21e492a640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7f21c4074120 0x7f21c4076540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.499+0000 7fab377fe640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7fab24074120 0x7fab24076540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.499+0000 7f935b7fe640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7f9344074120 0x7f9344076540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.499+0000 7f21df7fe640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21c406bf00 0x7f21c406e3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21cc034000 tx=0x7f21cc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.500+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== osd.7 v2:172.21.15.100:6824/4121682080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21d4011e50 con 0x7f21c4074120 2024-09-10T09:22:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.500+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== osd.5 v2:172.21.15.100:6808/1581570554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9344076bf0 con 0x7f9344074120 2024-09-10T09:22:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.500+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== osd.3 v2:172.21.15.12:6824/2116037928 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab28027e50 con 0x7fab24074120 2024-09-10T09:22:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.527+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 --> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8cc0ab5d0 con 0x7ff8b8074120 2024-09-10T09:22:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.527+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 --> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f58037420 con 0x7f4f44074120 2024-09-10T09:22:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.527+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 --> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0dc14e5a0 con 0x7fe0c8074080 2024-09-10T09:22:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.527+0000 7f4f5cff9640 1 -- 172.21.15.12:0/849900095 <== osd.2 v2:172.21.15.12:6800/2895280715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4f58037420 con 0x7f4f44074120 2024-09-10T09:22:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.527+0000 7ff8b3fff640 1 -- 172.21.15.12:0/3997102125 <== osd.6 v2:172.21.15.100:6800/2090972208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff8cc0ab5d0 con 0x7ff8b8074120 2024-09-10T09:22:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.527+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 --> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbec8157c70 con 0x7fbeb4074020 2024-09-10T09:22:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbeaf7fe640 1 -- 172.21.15.12:0/3061751709 <== osd.1 v2:172.21.15.12:6811/3866682510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbec8157c70 con 0x7fbeb4074020 2024-09-10T09:22:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fe0d97fa640 1 -- 172.21.15.12:0/2791635890 <== osd.0 v2:172.21.15.12:6808/902038076 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe0dc14e5a0 con 0x7fe0c8074080 2024-09-10T09:22:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7ff8b8074120 msgr2=0x7ff8b8076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8b1ffb640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7ff8b8074120 0x7ff8b8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7f4f44074120 msgr2=0x7f4f44076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7f4f650cf640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7f4f44074120 0x7f4f44076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff8b806bf00 msgr2=0x7ff8b806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8b1ffb640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff8b806bf00 0x7ff8b806e3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009f60 tx=0x7ff8c40094f0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8cc162ae0 msgr2=0x7ff8cc1f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8b1ffb640 1 --2- 172.21.15.12:0/3997102125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8cc162ae0 0x7ff8cc1f7b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000b7b0 tx=0x7ff8c000bc70 comp rx=0 tx=0).stop 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7ff8cbfff640 1 -- 172.21.15.12:0/3997102125 reap_dead start 2024-09-10T09:22:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fe0c8074080 msgr2=0x7fe0c80764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e18cf640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fe0c8074080 0x7fe0c80764a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fbeb4074020 msgr2=0x7fbeb4076440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbecd42c640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fbeb4074020 0x7fbeb4076440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbeb406be80 msgr2=0x7fbeb406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbecd42c640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbeb406be80 0x7fbeb406e340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbebc006fd0 tx=0x7fbebc009060 comp rx=0 tx=0).stop 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec8160750 msgr2=0x7fbec8200a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.528+0000 7fbecd42c640 1 --2- 172.21.15.12:0/3061751709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbec8160750 0x7fbec8200a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbec000be00 tx=0x7fbec000bef0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fbec77fe640 1 -- 172.21.15.12:0/3061751709 reap_dead start 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 shutdown_connections 2024-09-10T09:22:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 >> 172.21.15.12:0/3061751709 conn(0x7fbec8062630 msgr2=0x7fbec8062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 shutdown_connections 2024-09-10T09:22:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 >> 172.21.15.12:0/3997102125 conn(0x7ff8cc062a50 msgr2=0x7ff8cc0b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4f4406bf00 msgr2=0x7f4f4406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4f4406bf00 0x7f4f4406e3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f5804c180 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2024-09-10T09:22:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f58008c10 msgr2=0x7f4f58186470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 --2- 172.21.15.12:0/849900095 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f58008c10 0x7f4f58186470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00c700 tx=0x7f4f4c00cbc0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f648ce640 1 -- 172.21.15.12:0/849900095 reap_dead start 2024-09-10T09:22:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 shutdown_connections 2024-09-10T09:22:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7ff8b1ffb640 1 -- 172.21.15.12:0/3997102125 wait complete. 2024-09-10T09:22:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 --> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f220c1f1560 con 0x7f21f8074f60 2024-09-10T09:22:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0c806be60 msgr2=0x7fe0c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e18cf640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0c806be60 0x7fe0c806e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b40d0 tx=0x7fe0d0008030 comp rx=0 tx=0).stop 2024-09-10T09:22:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0dc0cf5c0 msgr2=0x7fe0dc0cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 shutdown_connections 2024-09-10T09:22:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fbecd42c640 1 -- 172.21.15.12:0/3061751709 wait complete. 2024-09-10T09:22:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 shutdown_connections 2024-09-10T09:22:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e18cf640 1 --2- 172.21.15.12:0/2791635890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0dc0cf5c0 0x7fe0dc0cfa40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b5df0 tx=0x7fe0d4007060 comp rx=0 tx=0).stop 2024-09-10T09:22:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 >> 172.21.15.12:0/849900095 conn(0x7f4f5801fb30 msgr2=0x7f4f5800c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7fe0e10ce640 1 -- 172.21.15.12:0/2791635890 reap_dead start 2024-09-10T09:22:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 shutdown_connections 2024-09-10T09:22:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 >> 172.21.15.12:0/2791635890 conn(0x7fe0dc0d1310 msgr2=0x7fe0dc06be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f2209ffb640 1 -- 172.21.15.12:0/2922107018 <== osd.4 v2:172.21.15.100:6816/3211705705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f220c1f1560 con 0x7f21f8074f60 2024-09-10T09:22:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.529+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 shutdown_connections 2024-09-10T09:22:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 shutdown_connections 2024-09-10T09:22:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7fe0e18cf640 1 -- 172.21.15.12:0/2791635890 wait complete. 2024-09-10T09:22:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f4f650cf640 1 -- 172.21.15.12:0/849900095 wait complete. 2024-09-10T09:22:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7f21f8074f60 msgr2=0x7f21f8077400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f21f37fe640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7f21f8074f60 0x7f21f8077400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 --> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f935c0b4e70 con 0x7f9344074120 2024-09-10T09:22:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21f806c230 msgr2=0x7f21f806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f21f37fe640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21f806c230 0x7f21f806e6f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2204033000 tx=0x7f2204009000 comp rx=0 tx=0).stop 2024-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f220c15a5c0 msgr2=0x7f220c148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f21f37fe640 1 --2- 172.21.15.12:0/2922107018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f220c15a5c0 0x7f220c148de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00b450 tx=0x7f21fc00b910 comp rx=0 tx=0).stop 2024-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.530+0000 7f221199a640 1 -- 172.21.15.12:0/2922107018 reap_dead start 2024-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 shutdown_connections 2024-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 >> 172.21.15.12:0/2922107018 conn(0x7f220c06bba0 msgr2=0x7f220c071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f9353fff640 1 -- 172.21.15.12:0/2923049067 <== osd.5 v2:172.21.15.100:6808/1581570554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f935c0b4e70 con 0x7f9344074120 2024-09-10T09:22:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 shutdown_connections 2024-09-10T09:22:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f21f37fe640 1 -- 172.21.15.12:0/2922107018 wait complete. 2024-09-10T09:22:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 --> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21c0002dd0 con 0x7f21c4074120 2024-09-10T09:22:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7f9344074120 msgr2=0x7f9344076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f93619b7640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7f9344074120 0x7f9344076540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7f21dcff9640 1 -- 172.21.15.12:0/3444588275 <== osd.7 v2:172.21.15.100:6824/4121682080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f21c0002dd0 con 0x7f21c4074120 2024-09-10T09:22:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f934406bf00 msgr2=0x7f934406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f934406bf00 0x7f934406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f934c000f60 tx=0x7f934c000ed0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.531+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 --> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab380cd440 con 0x7fab24074120 2024-09-10T09:22:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c0af900 msgr2=0x7f935c071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 --2- 172.21.15.12:0/2923049067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f935c0af900 0x7f935c071bb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f934800e850 tx=0x7f934800ed10 comp rx=0 tx=0).stop 2024-09-10T09:22:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f935b7fe640 1 -- 172.21.15.12:0/2923049067 reap_dead start 2024-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7fab1f7fe640 1 -- 172.21.15.12:0/1733640241 <== osd.3 v2:172.21.15.12:6824/2116037928 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab380cd440 con 0x7fab24074120 2024-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 shutdown_connections 2024-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 >> 172.21.15.12:0/2923049067 conn(0x7f935c062cc0 msgr2=0x7f935c1630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7f21c4074120 msgr2=0x7f21c4076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f21e512b640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7f21c4074120 0x7f21c4076540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21c406bf00 msgr2=0x7f21c406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 shutdown_connections 2024-09-10T09:22:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.532+0000 7f21e512b640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f21c406bf00 0x7f21c406e3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21cc034000 tx=0x7f21cc02e000 comp rx=0 tx=0).stop 2024-09-10T09:22:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d8005a50 msgr2=0x7f21d804df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f93619b7640 1 -- 172.21.15.12:0/2923049067 wait complete. 2024-09-10T09:22:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f21e512b640 1 --2- 172.21.15.12:0/3444588275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d8005a50 0x7f21d804df70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c410 tx=0x7f21d400c8d0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f21e492a640 1 -- 172.21.15.12:0/3444588275 reap_dead start 2024-09-10T09:22:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 shutdown_connections 2024-09-10T09:22:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 >> 172.21.15.12:0/3444588275 conn(0x7f21d8036080 msgr2=0x7f21d80e5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7fab24074120 msgr2=0x7fab24076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab3d61e640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7fab24074120 0x7fab24076540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 shutdown_connections 2024-09-10T09:22:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab2406bf00 msgr2=0x7fab2406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab3d61e640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab2406bf00 0x7fab2406e3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab2c033000 tx=0x7fab2c009030 comp rx=0 tx=0).stop 2024-09-10T09:22:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 msgr2=0x7fab3815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab3d61e640 1 --2- 172.21.15.12:0/1733640241 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab20004800 0x7fab3815a840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fab28009fd0 tx=0x7fab28011930 comp rx=0 tx=0).stop 2024-09-10T09:22:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.533+0000 7fab377fe640 1 -- 172.21.15.12:0/1733640241 reap_dead start 2024-09-10T09:22:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.534+0000 7f21e512b640 1 -- 172.21.15.12:0/3444588275 wait complete. 2024-09-10T09:22:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.534+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 shutdown_connections 2024-09-10T09:22:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.534+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 >> 172.21.15.12:0/1733640241 conn(0x7fab3806bba0 msgr2=0x7fab38163900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.534+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 shutdown_connections 2024-09-10T09:22:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.535+0000 7fab3d61e640 1 -- 172.21.15.12:0/1733640241 wait complete. 2024-09-10T09:22:44.606 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:44.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T09:22:44.607 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:44.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T09:22:44.608 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:44.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T09:22:44.609 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:44.609 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T09:22:44.610 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:44.610 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T09:22:44.611 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2024-09-10T09:22:44.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T09:22:44.612 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:44.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T09:22:44.613 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:44.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T09:22:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.822+0000 7fab3834b640 1 Processor -- start 2024-09-10T09:22:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.822+0000 7fab3834b640 1 -- start start 2024-09-10T09:22:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7f459405c640 1 Processor -- start 2024-09-10T09:22:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7fe390386640 1 Processor -- start 2024-09-10T09:22:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7f8e262a5640 1 Processor -- start 2024-09-10T09:22:44.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7ff77d1bc640 1 Processor -- start 2024-09-10T09:22:44.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7f8e262a5640 1 -- start start 2024-09-10T09:22:44.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7ff77d1bc640 1 -- start start 2024-09-10T09:22:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab3834b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30070880 0x7fab300d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab3834b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab300cf180 0x7fab300cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab3834b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3015d110 con 0x7fab30159fb0 2024-09-10T09:22:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab3834b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fab3015d3f0 con 0x7fab300cf180 2024-09-10T09:22:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab3834b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab3015d6d0 con 0x7fab30070880 2024-09-10T09:22:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7f459405c640 1 -- start start 2024-09-10T09:22:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab368e8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab300cf180 0x7fab300cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab368e8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab300cf180 0x7fab300cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45884/0 (socket says 172.21.15.12:45884) 2024-09-10T09:22:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab368e8640 1 -- 172.21.15.12:0/2556542963 learned_addr learned my addr 172.21.15.12:0/2556542963 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.824+0000 7fab360e7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fab30159fb0 0x7fab3015c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51620/0 (socket says 172.21.15.12:51620) 2024-09-10T09:22:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fab358e6640 1 --2- 172.21.15.12:0/2556542963 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30070880 0x7fab300d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.823+0000 7fe390386640 1 -- start start 2024-09-10T09:22:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe390386640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe38806c2b0 0x7fe3880cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe390386640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe3880af900 0x7fe3880cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f8e262a5640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e200d4280 0x7f8e200d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f8e262a5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e200d2a10 con 0x7f8e200cf420 2024-09-10T09:22:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f8e262a5640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e200d2cf0 con 0x7f8e20161ee0 2024-09-10T09:22:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe390386640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3880cf3a0 con 0x7fe388162930 2024-09-10T09:22:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe390386640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe3880b4870 con 0x7fe3880af900 2024-09-10T09:22:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe390386640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe3880afd70 con 0x7fe38806c2b0 2024-09-10T09:22:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff77d1bc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff778156a20 0x7ff7780ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff77d1bc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff7780ce9c0 0x7ff77815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff77d1bc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7781600d0 con 0x7ff77815d0c0 2024-09-10T09:22:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff77d1bc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780cee20 con 0x7ff778156a20 2024-09-10T09:22:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff77d1bc640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff7781603b0 con 0x7ff7780ce9c0 2024-09-10T09:22:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f8e262a5640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8e200d2fd0 con 0x7f8e200d4280 2024-09-10T09:22:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe38d921640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe38806c2b0 0x7fe3880cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe38d921640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe38806c2b0 0x7fe3880cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44290/0 (socket says 172.21.15.12:44290) 2024-09-10T09:22:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fe38d921640 1 -- 172.21.15.12:0/100770741 learned_addr learned my addr 172.21.15.12:0/100770741 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f8e24842640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8e200cf420 0x7f8e200cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51628/0 (socket says 172.21.15.12:51628) 2024-09-10T09:22:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f8e24842640 1 -- 172.21.15.12:0/1614081531 learned_addr learned my addr 172.21.15.12:0/1614081531 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f735745e640 1 Processor -- start 2024-09-10T09:22:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff7777fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff7780ce9c0 0x7ff77815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7f459405c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f458c0ced90 0x7f458c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7ff777fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff778156a20 0x7ff7780ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f459405c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f458c0d26f0 con 0x7f458c15eac0 2024-09-10T09:22:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f4591df8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f458c15eac0 0x7f458c0b61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51650/0 (socket says 172.21.15.12:51650) 2024-09-10T09:22:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f459405c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f458c0d29d0 con 0x7f458c0b68d0 2024-09-10T09:22:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f459405c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f458c0d2cb0 con 0x7f458c0ced90 2024-09-10T09:22:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f4591df8640 1 -- 172.21.15.12:0/1415860344 learned_addr learned my addr 172.21.15.12:0/1415860344 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fab368e8640 1 -- 172.21.15.12:0/2556542963 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30070880 msgr2=0x7fab300d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.825+0000 7fab368e8640 1 --2- 172.21.15.12:0/2556542963 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30070880 0x7fab300d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fab368e8640 1 -- 172.21.15.12:0/2556542963 >> v1:172.21.15.12:6789/0 conn(0x7fab30159fb0 legacy=0x7fab3015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fab368e8640 1 -- 172.21.15.12:0/2556542963 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab300d1640 con 0x7fab300cf180 2024-09-10T09:22:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765102118 0 0) 0x7fe384001110 con 0x7fe388162930 2024-09-10T09:22:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe374003520 con 0x7fe388162930 2024-09-10T09:22:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f45925f9640 1 --2- 172.21.15.12:0/1415860344 >> v2:172.21.15.100:3300/0 conn(0x7f458c0ced90 0x7f458c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7ff7777fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff7780ce9c0 0x7ff77815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44296/0 (socket says 172.21.15.12:44296) 2024-09-10T09:22:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7ff7777fe640 1 -- 172.21.15.12:0/308166589 learned_addr learned my addr 172.21.15.12:0/308166589 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f8e1f7fe640 1 --2- 172.21.15.12:0/1614081531 >> v2:172.21.15.100:3300/0 conn(0x7f8e200d4280 0x7f8e200d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38e923640 1 --2- 172.21.15.12:0/100770741 >> v2:172.21.15.12:3300/0 conn(0x7fe3880af900 0x7fe3880cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965847214 0 0) 0x7fe374003520 con 0x7fe388162930 2024-09-10T09:22:44.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 >> v2:172.21.15.100:3300/0 conn(0x7fe38806c2b0 msgr2=0x7fe3880cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 --2- 172.21.15.12:0/100770741 >> v2:172.21.15.100:3300/0 conn(0x7fe38806c2b0 0x7fe3880cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 >> v2:172.21.15.12:3300/0 conn(0x7fe3880af900 msgr2=0x7fe3880cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 --2- 172.21.15.12:0/100770741 >> v2:172.21.15.12:3300/0 conn(0x7fe3880af900 0x7fe3880cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f02389fa640 1 Processor -- start 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f45925f9640 1 -- 172.21.15.12:0/1415860344 >> v1:172.21.15.100:6789/0 conn(0x7f458c0b68d0 legacy=0x7f458c0d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f45925f9640 1 -- 172.21.15.12:0/1415860344 >> v1:172.21.15.12:6789/0 conn(0x7f458c15eac0 legacy=0x7f458c0b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f45925f9640 1 -- 172.21.15.12:0/1415860344 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c0d2f90 con 0x7f458c0ced90 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284758178 0 0) 0x7f8e200d2cf0 con 0x7f8e20161ee0 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e08003520 con 0x7f8e20161ee0 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156320036 0 0) 0x7f8e200d2a10 con 0x7f8e200cf420 2024-09-10T09:22:44.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e200d2cf0 con 0x7f8e200cf420 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3880b4010 con 0x7fe388162930 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fe384001840 con 0x7fe388162930 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 >> v1:172.21.15.100:6789/0 conn(0x7fe388162930 legacy=0x7fe38806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe374003a30 0x7fe374003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe374004800 0x7fe374004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7fe38d120640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3740051c0 0x7fe37400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3880b4870 con 0x7fe3740051c0 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe3880afd70 con 0x7fe374003a30 2024-09-10T09:22:44.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe37400c090 con 0x7fe374004800 2024-09-10T09:22:44.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7ff7777fe640 1 -- 172.21.15.12:0/308166589 >> v2:172.21.15.12:3300/0 conn(0x7ff778156a20 msgr2=0x7ff7780ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.826+0000 7f735745e640 1 -- start start 2024-09-10T09:22:44.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fab368e8640 1 --2- 172.21.15.12:0/2556542963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab300cf610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab2800f630 tx=0x7fab2802ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54750d0f4f861236 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1596467795 0 0) 0x7f8e200d2cf0 con 0x7f8e200cf420 2024-09-10T09:22:44.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/1614081531 >> v1:172.21.15.100:6789/0 conn(0x7f8e20161ee0 legacy=0x7f8e200ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f45925f9640 1 --2- 172.21.15.12:0/1415860344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c0ced90 0x7f458c0cfc80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f457c0097a0 tx=0x7f457c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ee26f800c977f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/1614081531 >> v1:172.21.15.12:6789/0 conn(0x7f8e200cf420 legacy=0x7f8e200cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38d921640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe374004800 0x7fe374004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e122640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe374003a30 0x7fe374003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e923640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3740051c0 0x7fe37400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/1614081531 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e200d32b0 con 0x7f8e200d4280 2024-09-10T09:22:44.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e122640 1 -- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe374004800 msgr2=0x7fe374004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e122640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe374004800 0x7fe374004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e122640 1 -- 172.21.15.12:0/100770741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3740051c0 msgr2=0x7fe37400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e122640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3740051c0 0x7fe37400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7fe38e923640 1 -- 172.21.15.12:0/100770741 reap_dead start 2024-09-10T09:22:44.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7f02389fa640 1 -- start start 2024-09-10T09:22:44.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f735745e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cfc30 0x7f73500d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f735745e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73500d50c0 con 0x7f735015e740 2024-09-10T09:22:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f73551fa640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f735015e740 0x7f73500cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51654/0 (socket says 172.21.15.12:51654) 2024-09-10T09:22:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.827+0000 7ff776ffd640 1 -- 172.21.15.12:0/308166589 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604757256 0 0) 0x7ff7781600d0 con 0x7ff77815d0c0 2024-09-10T09:22:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7ff7777fe640 1 --2- 172.21.15.12:0/308166589 >> v2:172.21.15.12:3300/0 conn(0x7ff778156a20 0x7ff7780ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7ff7777fe640 1 -- 172.21.15.12:0/308166589 >> v1:172.21.15.12:6789/0 conn(0x7ff77815d0c0 legacy=0x7ff7780d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7ff7777fe640 1 -- 172.21.15.12:0/308166589 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff778160690 con 0x7ff7780ce9c0 2024-09-10T09:22:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7ff777fff640 1 --2- 172.21.15.12:0/308166589 >> v2:172.21.15.12:3300/0 conn(0x7ff778156a20 0x7ff7780ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:44.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f02389fa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f022c005a60 0x7f022c053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f73551fa640 1 -- 172.21.15.12:0/444903308 learned_addr learned my addr 172.21.15.12:0/444903308 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73500d4020 con 0x7f735015eb20 2024-09-10T09:22:44.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f73500d4c30 con 0x7f73500cfc30 2024-09-10T09:22:44.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947987499 0 0) 0x7f73500d50c0 con 0x7f735015e740 2024-09-10T09:22:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f733c003520 con 0x7f735015e740 2024-09-10T09:22:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f02337fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f022c005a60 0x7f022c053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f73549f9640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cfc30 0x7f73500d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7fe38e122640 1 -- 172.21.15.12:0/100770741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe374003520 con 0x7fe374003a30 2024-09-10T09:22:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f4590df6640 1 -- 172.21.15.12:0/1415860344 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c037070 con 0x7f458c0ced90 2024-09-10T09:22:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f4590df6640 1 -- 172.21.15.12:0/1415860344 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457c032440 con 0x7f458c0ced90 2024-09-10T09:22:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f4590df6640 1 -- 172.21.15.12:0/1415860344 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c032810 con 0x7f458c0ced90 2024-09-10T09:22:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f8e1f7fe640 1 --2- 172.21.15.12:0/1614081531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200d4280 0x7f8e200d3ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8e140097a0 tx=0x7f8e1402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc15cd88c67df6d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7ff7777fe640 1 --2- 172.21.15.12:0/308166589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7780ce9c0 0x7ff77815cb80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff7780afbf0 tx=0x7ff76402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8bee54276820701 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14037070 con 0x7f8e200d4280 2024-09-10T09:22:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7fab350e5640 1 -- 172.21.15.12:0/2556542963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2802f640 con 0x7fab300cf180 2024-09-10T09:22:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7fab350e5640 1 -- 172.21.15.12:0/2556542963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2802f7e0 con 0x7fab300cf180 2024-09-10T09:22:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7fab350e5640 1 -- 172.21.15.12:0/2556542963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2802fbb0 con 0x7fab300cf180 2024-09-10T09:22:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f02337fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f022c005a60 0x7f022c053f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44308/0 (socket says 172.21.15.12:44308) 2024-09-10T09:22:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1402ac50 con 0x7f8e200d4280 2024-09-10T09:22:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f8e1effd640 1 -- 172.21.15.12:0/1614081531 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e100015f0 con 0x7f8e200d4280 2024-09-10T09:22:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7ff776ffd640 1 -- 172.21.15.12:0/308166589 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764037070 con 0x7ff7780ce9c0 2024-09-10T09:22:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7ff776ffd640 1 -- 172.21.15.12:0/308166589 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff764032440 con 0x7ff7780ce9c0 2024-09-10T09:22:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7ff776ffd640 1 -- 172.21.15.12:0/308166589 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764032810 con 0x7ff7780ce9c0 2024-09-10T09:22:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.828+0000 7f0232ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f022c0e7120 0x7f022c005e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51656/0 (socket says 172.21.15.12:51656) 2024-09-10T09:22:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f02389fa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 0x7f022c01d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f0232ffd640 1 -- 172.21.15.12:0/818312232 learned_addr learned my addr 172.21.15.12:0/818312232 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022c052330 con 0x7f022c0e7120 2024-09-10T09:22:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f022c0520e0 con 0x7f022c005a60 2024-09-10T09:22:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f022c006c80 con 0x7f022c04eb60 2024-09-10T09:22:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 -- 172.21.15.12:0/1415860344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c0ced90 msgr2=0x7f458c0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 --2- 172.21.15.12:0/1415860344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c0ced90 0x7f458c0cfc80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f457c0097a0 tx=0x7f457c02a180 comp rx=0 tx=0).stop 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 -- 172.21.15.12:0/1415860344 shutdown_connections 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2076056307 0 0) 0x7f733c003520 con 0x7f735015e740 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cfc30 msgr2=0x7f73500d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cfc30 0x7f73500d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 >> v1:172.21.15.100:6789/0 conn(0x7f735015eb20 legacy=0x7f73500b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73500d4300 con 0x7f735015e740 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f7340001670 con 0x7f735015e740 2024-09-10T09:22:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 >> v1:172.21.15.12:6789/0 conn(0x7f735015e740 legacy=0x7f73500cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f733c0039e0 0x7f733c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f733c004800 0x7f733c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f733c005210 0x7f733c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f73500d4c30 con 0x7f733c004800 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f733c00c110 con 0x7f733c005210 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f733c00c310 con 0x7f733c0039e0 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73551fa640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f733c0039e0 0x7f733c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73559fb640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f733c005210 0x7f733c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73551fa640 1 -- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f733c005210 msgr2=0x7f733c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73551fa640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f733c005210 0x7f733c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73551fa640 1 -- 172.21.15.12:0/444903308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f733c004800 msgr2=0x7f733c004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73551fa640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f733c004800 0x7f733c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73551fa640 1 -- 172.21.15.12:0/444903308 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c003520 con 0x7f733c0039e0 2024-09-10T09:22:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.829+0000 7f73559fb640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f733c005210 0x7f733c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 --2- 172.21.15.12:0/1415860344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c0ced90 0x7f458c0cfc80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 -- 172.21.15.12:0/1415860344 >> 172.21.15.12:0/1415860344 conn(0x7f458c0d11c0 msgr2=0x7f458c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f8e262a5640 1 -- 172.21.15.12:0/1614081531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200d4280 msgr2=0x7f8e200d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 -- 172.21.15.12:0/2556542963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 msgr2=0x7fab300cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 --2- 172.21.15.12:0/2556542963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab300cf610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab2800f630 tx=0x7fab2802ed40 comp rx=0 tx=0).stop 2024-09-10T09:22:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 -- 172.21.15.12:0/1415860344 shutdown_connections 2024-09-10T09:22:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fe38e122640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe374003a30 0x7fe374003e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3740055a0 tx=0x7fe374005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2d0d6ce6e4c35be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 -- 172.21.15.12:0/2556542963 shutdown_connections 2024-09-10T09:22:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 --2- 172.21.15.12:0/2556542963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab300cf610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 --2- 172.21.15.12:0/2556542963 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30070880 0x7fab300d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 -- 172.21.15.12:0/2556542963 >> 172.21.15.12:0/2556542963 conn(0x7fab3006f360 msgr2=0x7fab3006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f459405c640 1 -- 172.21.15.12:0/1415860344 wait complete. 2024-09-10T09:22:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 -- 172.21.15.12:0/2556542963 shutdown_connections 2024-09-10T09:22:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f8e262a5640 1 --2- 172.21.15.12:0/1614081531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200d4280 0x7f8e200d3ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8e140097a0 tx=0x7f8e1402a1c0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f8febb3b640 1 Processor -- start 2024-09-10T09:22:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f8e262a5640 1 -- 172.21.15.12:0/1614081531 shutdown_connections 2024-09-10T09:22:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f8e262a5640 1 --2- 172.21.15.12:0/1614081531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200d4280 0x7f8e200d3ab0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8e140097a0 tx=0x7f8e1402a1c0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f8e262a5640 1 -- 172.21.15.12:0/1614081531 >> 172.21.15.12:0/1614081531 conn(0x7f8e20062c60 msgr2=0x7f8e200d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 -- 172.21.15.12:0/308166589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7780ce9c0 msgr2=0x7ff77815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 --2- 172.21.15.12:0/308166589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7780ce9c0 0x7ff77815cb80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff7780afbf0 tx=0x7ff76402a270 comp rx=0 tx=0).stop 2024-09-10T09:22:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f0233fff640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 0x7f022c01d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f8e262a5640 1 -- 172.21.15.12:0/1614081531 shutdown_connections 2024-09-10T09:22:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384007d50 con 0x7fe374003a30 2024-09-10T09:22:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe384031620 con 0x7fe374003a30 2024-09-10T09:22:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7fe38d120640 1 -- 172.21.15.12:0/100770741 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384031a10 con 0x7fe374003a30 2024-09-10T09:22:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f8febb3b640 1 -- start start 2024-09-10T09:22:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331954583 0 0) 0x7f022c052330 con 0x7f022c0e7120 2024-09-10T09:22:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f8e262a5640 1 -- 172.21.15.12:0/1614081531 wait complete. 2024-09-10T09:22:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0224003520 con 0x7f022c0e7120 2024-09-10T09:22:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f459405c640 1 Processor -- start 2024-09-10T09:22:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f459405c640 1 -- start start 2024-09-10T09:22:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8e262a5640 1 Processor -- start 2024-09-10T09:22:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8e262a5640 1 -- start start 2024-09-10T09:22:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 -- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe374003a30 msgr2=0x7fe374003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe374003a30 0x7fe374003e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3740055a0 tx=0x7fe374005830 comp rx=0 tx=0).stop 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 -- 172.21.15.12:0/100770741 shutdown_connections 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 --2- 172.21.15.12:0/100770741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe374003a30 0x7fe374003e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 -- 172.21.15.12:0/100770741 >> 172.21.15.12:0/100770741 conn(0x7fe388062cc0 msgr2=0x7fe38806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 -- 172.21.15.12:0/100770741 shutdown_connections 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f73551fa640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f733c0039e0 0x7f733c003de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f734000c240 tx=0x7f733c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d246c7c900d3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340007d60 con 0x7f733c0039e0 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734002e070 con 0x7f733c0039e0 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f7347fff640 1 -- 172.21.15.12:0/444903308 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340005db0 con 0x7f733c0039e0 2024-09-10T09:22:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f733c0039e0 msgr2=0x7f733c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f735745e640 1 --2- 172.21.15.12:0/444903308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f733c0039e0 0x7f733c003de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f734000c240 tx=0x7f733c005830 comp rx=0 tx=0).stop 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f73559fb640 1 -- 172.21.15.12:0/444903308 reap_dead start 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 shutdown_connections 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 >> 172.21.15.12:0/444903308 conn(0x7f735006bff0 msgr2=0x7f735006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 shutdown_connections 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3022591899 0 0) 0x7f0224003520 con 0x7f022c0e7120 2024-09-10T09:22:44.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 msgr2=0x7f022c01d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 0x7f022c01d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 >> v2:172.21.15.100:3300/0 conn(0x7f022c005a60 msgr2=0x7f022c053f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 --2- 172.21.15.12:0/818312232 >> v2:172.21.15.100:3300/0 conn(0x7f022c005a60 0x7f022c053f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c006f60 con 0x7f022c0e7120 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f0220001670 con 0x7f022c0e7120 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 >> v1:172.21.15.12:6789/0 conn(0x7f022c0e7120 legacy=0x7f022c005e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f02327fc640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f0224003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7f02337fe640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f0224003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02327fc640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0224004800 0x7f0224004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02327fc640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 0x7f02240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f022c0520e0 con 0x7f0224003a30 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f0232ffd640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0224004800 0x7f0224004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f022c006c80 con 0x7f0224004800 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f022400bb00 con 0x7f022c04eb60 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f0233fff640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 0x7f02240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02337fe640 1 -- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 msgr2=0x7f02240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02337fe640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04eb60 0x7f02240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02337fe640 1 -- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0224004800 msgr2=0x7f0224004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02337fe640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0224004800 0x7f0224004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f02337fe640 1 -- 172.21.15.12:0/818312232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0224003520 con 0x7f0224003a30 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f8febb3b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8fdc0339e0 0x7f8fdc005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f8febb3b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fdc005fd0 0x7f8fdc01cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f8febb3b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc006de0 con 0x7f8fdc0e29b0 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f8febb3b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc006440 con 0x7f8fdc005fd0 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7f8febb3b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc0070c0 con 0x7f8fdc0339e0 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fdc005fd0 0x7f8fdc01cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fdc005fd0 0x7f8fdc01cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45914/0 (socket says 172.21.15.12:45914) 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 -- 172.21.15.12:0/902186043 learned_addr learned my addr 172.21.15.12:0/902186043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 -- 172.21.15.12:0/902186043 >> v2:172.21.15.100:3300/0 conn(0x7f8fdc0339e0 msgr2=0x7f8fdc005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 --2- 172.21.15.12:0/902186043 >> v2:172.21.15.100:3300/0 conn(0x7f8fdc0339e0 0x7f8fdc005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 -- 172.21.15.12:0/902186043 >> v1:172.21.15.100:6789/0 conn(0x7f8fdc0e29b0 legacy=0x7f8fdc0e6f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f8fea0d8640 1 -- 172.21.15.12:0/902186043 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc0073a0 con 0x7f8fdc005fd0 2024-09-10T09:22:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f02337fe640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f0224003e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0228009d10 tx=0x7f0224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34a491236e1107b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f459405c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458c0b68d0 0x7f458c0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 -- 172.21.15.12:0/308166589 shutdown_connections 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 --2- 172.21.15.12:0/308166589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7780ce9c0 0x7ff77815cb80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 --2- 172.21.15.12:0/308166589 >> v2:172.21.15.12:3300/0 conn(0x7ff778156a20 0x7ff7780ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 -- 172.21.15.12:0/308166589 >> 172.21.15.12:0/308166589 conn(0x7ff77806e910 msgr2=0x7ff77806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 -- 172.21.15.12:0/308166589 shutdown_connections 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.831+0000 7ff77d1bc640 1 -- 172.21.15.12:0/308166589 wait complete. 2024-09-10T09:22:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7ff77d1bc640 1 Processor -- start 2024-09-10T09:22:44.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7ff77d1bc640 1 -- start start 2024-09-10T09:22:44.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fe390386640 1 -- 172.21.15.12:0/100770741 wait complete. 2024-09-10T09:22:44.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f459405c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 0x7f458c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f459405c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c15eac0 0x7f458c1f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.830+0000 7fab3834b640 1 -- 172.21.15.12:0/2556542963 wait complete. 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fab3834b640 1 Processor -- start 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.832+0000 7fab3834b640 1 -- start start 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7fab3834b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab30070880 0x7fab3008c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7fab3834b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab30155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7fab3834b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30159fb0 0x7fab30204270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7fab3834b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab300d2220 con 0x7fab300cf180 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7fab3834b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab300d20a0 con 0x7fab30070880 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7fab3834b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab3015d9b0 con 0x7fab30159fb0 2024-09-10T09:22:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7fe390386640 1 Processor -- start 2024-09-10T09:22:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228037070 con 0x7f0224003a30 2024-09-10T09:22:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0228005990 con 0x7f0224003a30 2024-09-10T09:22:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f02327fc640 1 -- 172.21.15.12:0/818312232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228009680 con 0x7f0224003a30 2024-09-10T09:22:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f459405c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0d2490 con 0x7f458c0b68d0 2024-09-10T09:22:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f459405c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0d2310 con 0x7f458c15eac0 2024-09-10T09:22:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.833+0000 7f735745e640 1 -- 172.21.15.12:0/444903308 wait complete. 2024-09-10T09:22:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f459405c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f458c0b79b0 con 0x7f458c0ced90 2024-09-10T09:22:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f735745e640 1 Processor -- start 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77d1bc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7780ce9c0 0x7ff7780b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77d1bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff778156a20 0x7ff7781578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77d1bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 0x7ff77815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77d1bc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff77815d690 con 0x7ff77815d0c0 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77d1bc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff77815d510 con 0x7ff778156a20 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77d1bc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff7780d0960 con 0x7ff7780ce9c0 2024-09-10T09:22:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f735745e640 1 -- start start 2024-09-10T09:22:44.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7f8fea0d8640 1 --2- 172.21.15.12:0/902186043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc01cdf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40637b0 tx=0x7f8fe40a62e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e9a741f021dab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e262a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200cf420 0x7f8e201f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e262a5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 0x7f8e20157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 0x7ff77815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 0x7ff77815bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45934/0 (socket says 172.21.15.12:45934) 2024-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 -- 172.21.15.12:0/188244023 learned_addr learned my addr 172.21.15.12:0/188244023 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e262a5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e20158a00 0x7f8e200b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e262a5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200b7880 con 0x7f8e20158a00 2024-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff777fff640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7780ce9c0 0x7ff7780b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff7777fe640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff778156a20 0x7ff7781578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e262a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201622c0 con 0x7f8e200cf420 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e262a5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8e200b7a00 con 0x7f8e20161ee0 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e1f7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 0x7f8e20157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e24842640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e20158a00 0x7f8e200b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e1f7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 0x7f8e20157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34618/0 (socket says 172.21.15.12:34618) 2024-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/3654658556 learned_addr learned my addr 172.21.15.12:0/3654658556 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.834+0000 7fe390386640 1 -- start start 2024-09-10T09:22:44.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f45915f7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 0x7f458c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 msgr2=0x7f0224003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f02389fa640 1 --2- 172.21.15.12:0/818312232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f0224003e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0228009d10 tx=0x7f0224005830 comp rx=0 tx=0).stop 2024-09-10T09:22:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f0233fff640 1 -- 172.21.15.12:0/818312232 reap_dead start 2024-09-10T09:22:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45915f7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 0x7f458c14fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34598/0 (socket says 172.21.15.12:34598) 2024-09-10T09:22:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45915f7640 1 -- 172.21.15.12:0/165808818 learned_addr learned my addr 172.21.15.12:0/165808818 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200cf420 msgr2=0x7f8e201f4a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:22:44.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e1f7fe640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200cf420 0x7f8e201f4a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 shutdown_connections 2024-09-10T09:22:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 >> 172.21.15.12:0/818312232 conn(0x7f022c036090 msgr2=0x7f022c0364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45925f9640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c15eac0 0x7f458c1f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/3654658556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e20158a00 msgr2=0x7f8e200b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 -- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7780ce9c0 msgr2=0x7ff7780b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7780ce9c0 0x7ff7780b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 -- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff778156a20 msgr2=0x7ff7781578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff778156a20 0x7ff7781578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f4591df8640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458c0b68d0 0x7f458c0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e1f7fe640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e20158a00 0x7f8e200b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7ff77c9bb640 1 -- 172.21.15.12:0/188244023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff778156e00 con 0x7ff77815d0c0 2024-09-10T09:22:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e1f7fe640 1 -- 172.21.15.12:0/3654658556 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e200b4fb0 con 0x7f8e20161ee0 2024-09-10T09:22:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fab360e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab30070880 0x7fab3008c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e24842640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e20158a00 0x7f8e200b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fab368e8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30159fb0 0x7fab30204270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8fe88d5640 1 -- 172.21.15.12:0/902186043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40b3070 con 0x7f8fdc005fd0 2024-09-10T09:22:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.835+0000 7f8fe88d5640 1 -- 172.21.15.12:0/902186043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe40ae440 con 0x7f8fdc005fd0 2024-09-10T09:22:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 -- 172.21.15.12:0/902186043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc005fd0 msgr2=0x7f8fdc01cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 --2- 172.21.15.12:0/902186043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc01cdf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40637b0 tx=0x7f8fe40a62e0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fab358e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab30155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fe390386640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe374003a30 0x7fe388161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fe390386640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38815d920 0x7fe38815dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fe390386640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 0x7fe3880ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 shutdown_connections 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 -- 172.21.15.12:0/902186043 shutdown_connections 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 --2- 172.21.15.12:0/902186043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc01cdf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 --2- 172.21.15.12:0/902186043 >> v2:172.21.15.100:3300/0 conn(0x7f8fdc0339e0 0x7f8fdc005a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 -- 172.21.15.12:0/902186043 >> 172.21.15.12:0/902186043 conn(0x7f8fdc0360c0 msgr2=0x7f8fdc0364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fe390386640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe388162d10 con 0x7fe374003a30 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fe390386640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe3880b4590 con 0x7fe38815d920 2024-09-10T09:22:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fe390386640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe3880cde00 con 0x7fe3880aaee0 2024-09-10T09:22:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f02389fa640 1 -- 172.21.15.12:0/818312232 wait complete. 2024-09-10T09:22:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fab360e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab30070880 0x7fab3008c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44364/0 (socket says 172.21.15.12:44364) 2024-09-10T09:22:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7fab360e7640 1 -- 172.21.15.12:0/3277979448 learned_addr learned my addr 172.21.15.12:0/3277979448 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8e1f7fe640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 0x7f8e20157af0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000c00 tx=0x7f8e140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f735745e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f735014ea00 0x7f73500c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f735745e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73500c99e0 0x7f73500ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45915f7640 1 -- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c15eac0 msgr2=0x7f458c1f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f735745e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cd120 0x7f73500c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45915f7640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c15eac0 0x7f458c1f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45915f7640 1 -- 172.21.15.12:0/165808818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458c0b68d0 msgr2=0x7f458c0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7ff77c9bb640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 0x7ff77815bac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c7b0 tx=0x7ff77000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f45915f7640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458c0b68d0 0x7f458c0ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.836+0000 7f8febb3b640 1 -- 172.21.15.12:0/902186043 shutdown_connections 2024-09-10T09:22:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f735745e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f73500d0ed0 con 0x7f73500c99e0 2024-09-10T09:22:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f45915f7640 1 -- 172.21.15.12:0/165808818 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c0cbbd0 con 0x7f458c0ced90 2024-09-10T09:22:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14037040 con 0x7f8e20161ee0 2024-09-10T09:22:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f735745e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73500d48c0 con 0x7f735014ea00 2024-09-10T09:22:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f735745e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f73500d1050 con 0x7f73500cd120 2024-09-10T09:22:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f45925f9640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c15eac0 0x7f458c1f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f4591df8640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458c0b68d0 0x7f458c0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e140044e0 con 0x7f8e20161ee0 2024-09-10T09:22:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f8e262a5640 1 -- 172.21.15.12:0/3654658556 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e200b5940 con 0x7f8e20161ee0 2024-09-10T09:22:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f45915f7640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 0x7f458c14fd20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f458000c440 tx=0x7f458000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f8e262a5640 1 -- 172.21.15.12:0/3654658556 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e200b5ee0 con 0x7f8e20161ee0 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770003ba0 con 0x7ff77815d0c0 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff770003d40 con 0x7ff77815d0c0 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab368e8640 1 -- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab30070880 msgr2=0x7fab3008c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab368e8640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab30070880 0x7fab3008c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab368e8640 1 -- 172.21.15.12:0/3277979448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 msgr2=0x7fab30155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab368e8640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab30155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab368e8640 1 -- 172.21.15.12:0/3277979448 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab300aaca0 con 0x7fab30159fb0 2024-09-10T09:22:44.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab368e8640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30159fb0 0x7fab30204270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab28035000 tx=0x7fab28004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14006e10 con 0x7f8e20161ee0 2024-09-10T09:22:44.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770003ba0 con 0x7ff77815d0c0 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 0x7fe3880ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 0x7fe3880ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34632/0 (socket says 172.21.15.12:34632) 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 -- 172.21.15.12:0/1524555779 learned_addr learned my addr 172.21.15.12:0/1524555779 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38d921640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38815d920 0x7fe38815dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e122640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe374003a30 0x7fe388161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 -- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38815d920 msgr2=0x7fe38815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38815d920 0x7fe38815dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 -- 172.21.15.12:0/1524555779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe374003a30 msgr2=0x7fe388161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe374003a30 0x7fe388161aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fe38e923640 1 -- 172.21.15.12:0/1524555779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38815e3e0 con 0x7fe3880aaee0 2024-09-10T09:22:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f73559fb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cd120 0x7f73500c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f73551fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f735014ea00 0x7f73500c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f73559fb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cd120 0x7f73500c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34644/0 (socket says 172.21.15.12:34644) 2024-09-10T09:22:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f73559fb640 1 -- 172.21.15.12:0/1846737416 learned_addr learned my addr 172.21.15.12:0/1846737416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7fab358e6640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab30155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7ff77d1bc640 1 -- 172.21.15.12:0/188244023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7780b1c10 con 0x7ff77815d0c0 2024-09-10T09:22:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7ff77d1bc640 1 -- 172.21.15.12:0/188244023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7781570c0 con 0x7ff77815d0c0 2024-09-10T09:22:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7f02389fa640 1 Processor -- start 2024-09-10T09:22:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f73549f9640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73500c99e0 0x7f73500ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7f73549f9640 1 -- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cd120 msgr2=0x7f73500c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7f73549f9640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cd120 0x7f73500c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7f73549f9640 1 -- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f735014ea00 msgr2=0x7f73500c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7f73549f9640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f735014ea00 0x7f73500c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7f73549f9640 1 -- 172.21.15.12:0/1846737416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73500caf50 con 0x7f73500c99e0 2024-09-10T09:22:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7fe38e923640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 0x7fe3880ab360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3880d10c0 tx=0x7fe38000f520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.837+0000 7f8febb3b640 1 -- 172.21.15.12:0/902186043 wait complete. 2024-09-10T09:22:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38000fe30 con 0x7fe3880aaee0 2024-09-10T09:22:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38001b070 con 0x7fe3880aaee0 2024-09-10T09:22:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380016660 con 0x7fe3880aaee0 2024-09-10T09:22:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7f8febb3b640 1 Processor -- start 2024-09-10T09:22:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38815e6c0 con 0x7fe3880aaee0 2024-09-10T09:22:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38815ec80 con 0x7fe3880aaee0 2024-09-10T09:22:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28045020 con 0x7fab30159fb0 2024-09-10T09:22:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab280079b0 con 0x7fab30159fb0 2024-09-10T09:22:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.838+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2802f640 con 0x7fab30159fb0 2024-09-10T09:22:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab301561d0 con 0x7fab30159fb0 2024-09-10T09:22:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab30156790 con 0x7fab30159fb0 2024-09-10T09:22:44.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e14044020 con 0x7f8e20161ee0 2024-09-10T09:22:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7f02389fa640 1 -- start start 2024-09-10T09:22:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f73549f9640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73500c99e0 0x7f73500ccbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73500ba7e0 tx=0x7f734c00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8e1cff9640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.839+0000 7f8febb3b640 1 -- start start 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8febb3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc04d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8febb3b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 0x7f8fdc037a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8febb3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc0e29b0 0x7f8fdc037fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8febb3b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0e2d90 con 0x7f8fdc0e29b0 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8febb3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc01c8d0 con 0x7f8fdc005fd0 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8febb3b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc00a250 con 0x7f8fdc0339e0 2024-09-10T09:22:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8e1ffff640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f8fe90d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 0x7f8fdc037a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8fe90d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 0x7f8fdc037a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34656/0 (socket says 172.21.15.12:34656) 2024-09-10T09:22:44.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8fe90d6640 1 -- 172.21.15.12:0/2935174794 learned_addr learned my addr 172.21.15.12:0/2935174794 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580017070 con 0x7f458c0ced90 2024-09-10T09:22:44.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c0cbeb0 con 0x7f458c0ced90 2024-09-10T09:22:44.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c0cc470 con 0x7f458c0ced90 2024-09-10T09:22:44.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e140aaca0 con 0x7f8e20161ee0 2024-09-10T09:22:44.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c004020 con 0x7f73500c99e0 2024-09-10T09:22:44.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73500c9eb0 con 0x7f73500c99e0 2024-09-10T09:22:44.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff770005070 con 0x7ff77815d0c0 2024-09-10T09:22:44.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8e1ffff640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e18001bd0 tx=0x7f8e18007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73500ca470 con 0x7f73500c99e0 2024-09-10T09:22:44.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7ff774ff9640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff76006c230 0x7ff76006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7ff77d1bc640 1 -- 172.21.15.12:0/188244023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7780d0cc0 con 0x7ff77815d0c0 2024-09-10T09:22:44.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff77000ce00 con 0x7ff77815d0c0 2024-09-10T09:22:44.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8e262a5640 1 -- 172.21.15.12:0/3654658556 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e00005290 con 0x7f8e20161ee0 2024-09-10T09:22:44.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7f02389fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f022c184620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8fe98d7640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc04d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7f8fea0d8640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc0e29b0 0x7f8fdc037fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.840+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe388069b00 con 0x7fe3880aaee0 2024-09-10T09:22:44.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe380016800 con 0x7fe3880aaee0 2024-09-10T09:22:44.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.841+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab300d1b60 con 0x7fab30159fb0 2024-09-10T09:22:44.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f8fe90d6640 1 -- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fdc005fd0 msgr2=0x7f8fdc04d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f8fe90d6640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc04d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f8fe90d6640 1 -- 172.21.15.12:0/2935174794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc0e29b0 msgr2=0x7f8fdc037fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7ff777fff640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff76006c230 0x7ff76006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02389fa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04b5e0 0x7f022c0e4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02389fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c0e4a70 0x7f022c0e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02389fa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f022c047b50 con 0x7f0224003a30 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02389fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f022c053a10 con 0x7f022c0e4a70 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02389fa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f022c047cd0 con 0x7f022c04b5e0 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f0232ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04b5e0 0x7f022c0e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f0232ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04b5e0 0x7f022c0e4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34668/0 (socket says 172.21.15.12:34668) 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f0232ffd640 1 -- 172.21.15.12:0/344549926 learned_addr learned my addr 172.21.15.12:0/344549926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:44.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f0233fff640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c0e4a70 0x7f022c0e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7fe37effd640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe36c06bf00 0x7fe36c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe38008b990 con 0x7fe3880aaee0 2024-09-10T09:22:44.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02337fe640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f022c184620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c1621e0 con 0x7f458c0ced90 2024-09-10T09:22:44.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7fe38e122640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe36c06bf00 0x7fe36c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f8fe90d6640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc0e29b0 0x7f8fdc037fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f8fe90d6640 1 -- 172.21.15.12:0/2935174794 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc04d6c0 con 0x7f8fdc0339e0 2024-09-10T09:22:44.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734c0041c0 con 0x7f73500c99e0 2024-09-10T09:22:44.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c0043b0 con 0x7f73500c99e0 2024-09-10T09:22:44.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f8fea0d8640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc0e29b0 0x7f8fdc037fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:44.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7f02337fe640 1 -- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04b5e0 msgr2=0x7f022c0e4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.842+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab28048020 con 0x7fab30159fb0 2024-09-10T09:22:44.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7fab26ffd640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab1406bf00 0x7fab1406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f02337fe640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04b5e0 0x7f022c0e4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f02337fe640 1 -- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c0e4a70 msgr2=0x7f022c0e2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:44.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f02337fe640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c0e4a70 0x7f022c0e2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:44.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f02337fe640 1 -- 172.21.15.12:0/344549926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c0381c0 con 0x7f0224003a30 2024-09-10T09:22:44.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f0233fff640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c0e4a70 0x7f022c0e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:44.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45800035f0 con 0x7f458c0ced90 2024-09-10T09:22:44.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f8fe90d6640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 0x7f8fdc037a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400b3e0 tx=0x7f8fd400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45800039e0 con 0x7f458c0ced90 2024-09-10T09:22:44.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab280afb20 con 0x7fab30159fb0 2024-09-10T09:22:44.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7fab360e7640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab1406bf00 0x7fab1406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f02337fe640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f022c184620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f022400ba50 tx=0x7f0228004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7ff777fff640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff76006c230 0x7ff76006e6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff768009560 tx=0x7ff768009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7330005290 con 0x7f73500c99e0 2024-09-10T09:22:44.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.843+0000 7fe38e122640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe36c06bf00 0x7fe36c06e3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe384034000 tx=0x7fe384033040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.844+0000 7fab360e7640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab1406bf00 0x7fab1406e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007c90 tx=0x7fab2c007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.844+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f734c01a020 con 0x7f73500c99e0 2024-09-10T09:22:44.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.844+0000 7f7345ffb640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f733406be30 0x7f733406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.844+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f734c08a670 con 0x7f73500c99e0 2024-09-10T09:22:44.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.844+0000 7f73551fa640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f733406be30 0x7f733406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.845+0000 7f73551fa640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f733406be30 0x7f733406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7340033000 tx=0x7f734002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.847+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e200b4fb0 con 0x7f8e20161ee0 2024-09-10T09:22:44.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.848+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228041020 con 0x7f0224003a30 2024-09-10T09:22:44.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.848+0000 7f02389fa640 1 -- 172.21.15.12:0/344549926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c184b60 con 0x7f0224003a30 2024-09-10T09:22:44.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.848+0000 7f02389fa640 1 -- 172.21.15.12:0/344549926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c0e5290 con 0x7f0224003a30 2024-09-10T09:22:44.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.848+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff770058930 con 0x7ff77815d0c0 2024-09-10T09:22:44.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.849+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0214005290 con 0x7f0224003a30 2024-09-10T09:22:44.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.851+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4015020 con 0x7f8fdc0339e0 2024-09-10T09:22:44.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.851+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc04d9a0 con 0x7f8fdc0339e0 2024-09-10T09:22:44.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.851+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc04df60 con 0x7f8fdc0339e0 2024-09-10T09:22:44.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.851+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe388069b00 con 0x7fe3880aaee0 2024-09-10T09:22:44.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.853+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc005a90 con 0x7f8fdc0339e0 2024-09-10T09:22:44.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.853+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f734c059020 con 0x7f73500c99e0 2024-09-10T09:22:44.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.853+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0228038040 con 0x7f0224003a30 2024-09-10T09:22:44.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.853+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228037030 con 0x7f0224003a30 2024-09-10T09:22:44.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.856+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab2804f030 con 0x7fab30159fb0 2024-09-10T09:22:44.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.855+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0228044020 con 0x7f0224003a30 2024-09-10T09:22:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.856+0000 7f021ffff640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f021806be30 0x7f021806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.856+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02280ab0f0 con 0x7f0224003a30 2024-09-10T09:22:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.856+0000 7f0232ffd640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f021806be30 0x7f021806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.857+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4011830 con 0x7f8fdc0339e0 2024-09-10T09:22:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.859+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f458001a070 con 0x7f458c0ced90 2024-09-10T09:22:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.858+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4011c80 con 0x7f8fdc0339e0 2024-09-10T09:22:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.858+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fd4018020 con 0x7f8fdc0339e0 2024-09-10T09:22:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.859+0000 7f8fda7fc640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fc806be60 0x7f8fc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.859+0000 7f8fe98d7640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fc806be60 0x7f8fc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.859+0000 7f0232ffd640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f021806be30 0x7f021806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0220001a50 tx=0x7f0220000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.860+0000 7f8fe98d7640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fc806be60 0x7f8fc806e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009870 tx=0x7f8fe0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.860+0000 7f458a7fc640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f457806bf00 0x7f457806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.860+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f458008a540 con 0x7f458c0ced90 2024-09-10T09:22:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.860+0000 7f4591df8640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f457806bf00 0x7f457806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.861+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8fd4057740 con 0x7f8fdc0339e0 2024-09-10T09:22:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.861+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f458c1621e0 con 0x7f458c0ced90 2024-09-10T09:22:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.861+0000 7f4591df8640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f457806bf00 0x7f457806e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4584009fc0 tx=0x7f45840095d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.861+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f022804b030 con 0x7f0224003a30 2024-09-10T09:22:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:44.865+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fd401f020 con 0x7f8fdc0339e0 2024-09-10T09:22:45.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.258+0000 7f8e262a5640 1 -- 172.21.15.12:0/3654658556 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8e00005580 con 0x7f8e20161ee0 2024-09-10T09:22:45.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.259+0000 7f8e1cff9640 1 -- 172.21.15.12:0/3654658556 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e140795b0 con 0x7f8e20161ee0 2024-09-10T09:22:45.259 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:45.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.259+0000 7ff77d1bc640 1 -- 172.21.15.12:0/188244023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff77806ee20 con 0x7ff77815d0c0 2024-09-10T09:22:45.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.260+0000 7ff774ff9640 1 -- 172.21.15.12:0/188244023 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff77005cc30 con 0x7ff77815d0c0 2024-09-10T09:22:45.260 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.261+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7330005850 con 0x7f73500c99e0 2024-09-10T09:22:45.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.262+0000 7f7345ffb640 1 -- 172.21.15.12:0/1846737416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f734c006c30 con 0x7f73500c99e0 2024-09-10T09:22:45.262 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.262+0000 7f8e067fc640 1 -- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e0c06be30 msgr2=0x7f8e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.262+0000 7f8e067fc640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e18001bd0 tx=0x7f8e18007c20 comp rx=0 tx=0).stop 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.262+0000 7f8e067fc640 1 -- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 msgr2=0x7f8e20157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.262+0000 7f8e067fc640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 0x7f8e20157af0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000c00 tx=0x7f8e140046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7f8e067fc640 1 -- 172.21.15.12:0/3654658556 shutdown_connections 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7f8e067fc640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7f8e067fc640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e20158a00 0x7f8e200b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7f8e067fc640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e20161ee0 0x7f8e20157af0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7f8e067fc640 1 --2- 172.21.15.12:0/3654658556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e200cf420 0x7f8e201f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7f8e067fc640 1 -- 172.21.15.12:0/3654658556 >> 172.21.15.12:0/3654658556 conn(0x7f8e20062c60 msgr2=0x7f8e200d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 -- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff76006c230 msgr2=0x7ff76006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff76006c230 0x7ff76006e6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff768009560 tx=0x7ff768009190 comp rx=0 tx=0).stop 2024-09-10T09:22:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 -- 172.21.15.12:0/188244023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 msgr2=0x7ff77815bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 0x7ff77815bac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff77000c7b0 tx=0x7ff77000cbb0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 -- 172.21.15.12:0/188244023 shutdown_connections 2024-09-10T09:22:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff76006c230 0x7ff76006e6f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815d0c0 0x7ff77815bac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff778156a20 0x7ff7781578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 --2- 172.21.15.12:0/188244023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7780ce9c0 0x7ff7780b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.263+0000 7ff76e7fc640 1 -- 172.21.15.12:0/188244023 >> 172.21.15.12:0/188244023 conn(0x7ff77806e910 msgr2=0x7ff77806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.264+0000 7f8e067fc640 1 -- 172.21.15.12:0/3654658556 shutdown_connections 2024-09-10T09:22:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.264+0000 7f8e067fc640 1 -- 172.21.15.12:0/3654658556 wait complete. 2024-09-10T09:22:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.264+0000 7ff76e7fc640 1 -- 172.21.15.12:0/188244023 shutdown_connections 2024-09-10T09:22:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.264+0000 7ff76e7fc640 1 -- 172.21.15.12:0/188244023 wait complete. 2024-09-10T09:22:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.265+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f733406be30 msgr2=0x7f733406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f733406be30 0x7f733406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7340033000 tx=0x7f734002e000 comp rx=0 tx=0).stop 2024-09-10T09:22:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73500c99e0 msgr2=0x7f73500ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73500c99e0 0x7f73500ccbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73500ba7e0 tx=0x7f734c00d8f0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 shutdown_connections 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f733406be30 0x7f733406e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f73500cd120 0x7f73500c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73500c99e0 0x7f73500ccbe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 --2- 172.21.15.12:0/1846737416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f735014ea00 0x7f73500c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 >> 172.21.15.12:0/1846737416 conn(0x7f735006bff0 msgr2=0x7f735006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 shutdown_connections 2024-09-10T09:22:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.266+0000 7f735745e640 1 -- 172.21.15.12:0/1846737416 wait complete. 2024-09-10T09:22:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.267+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe3880cd750 con 0x7fe3880aaee0 2024-09-10T09:22:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.267+0000 7fe37effd640 1 -- 172.21.15.12:0/1524555779 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe38005a320 con 0x7fe3880aaee0 2024-09-10T09:22:45.271 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2024-09-10T09:22:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.272+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe36c06bf00 msgr2=0x7fe36c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.272+0000 7fe390386640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe36c06bf00 0x7fe36c06e3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe384034000 tx=0x7fe384033040 comp rx=0 tx=0).stop 2024-09-10T09:22:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.272+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 msgr2=0x7fe3880ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.272+0000 7fe390386640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 0x7fe3880ab360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3880d10c0 tx=0x7fe38000f520 comp rx=0 tx=0).stop 2024-09-10T09:22:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 shutdown_connections 2024-09-10T09:22:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe36c06bf00 0x7fe36c06e3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe3880aaee0 0x7fe3880ab360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe38815d920 0x7fe38815dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 --2- 172.21.15.12:0/1524555779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe374003a30 0x7fe388161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 >> 172.21.15.12:0/1524555779 conn(0x7fe388062cc0 msgr2=0x7fe38815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fab300b2b70 con 0x7fab30159fb0 2024-09-10T09:22:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 shutdown_connections 2024-09-10T09:22:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.273+0000 7fe390386640 1 -- 172.21.15.12:0/1524555779 wait complete. 2024-09-10T09:22:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.274+0000 7fab26ffd640 1 -- 172.21.15.12:0/3277979448 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab2807e4b0 con 0x7fab30159fb0 2024-09-10T09:22:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.274+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0214005850 con 0x7f0224003a30 2024-09-10T09:22:45.276 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.275+0000 7f021ffff640 1 -- 172.21.15.12:0/344549926 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0228079430 con 0x7f0224003a30 2024-09-10T09:22:45.277 INFO:teuthology.orchestra.run.smithi012.stdout:60129542148 2024-09-10T09:22:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.275+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8fdc036f40 con 0x7f8fdc0339e0 2024-09-10T09:22:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.278+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f458c0ba450 con 0x7f458c0ced90 2024-09-10T09:22:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.278+0000 7f8fda7fc640 1 -- 172.21.15.12:0/2935174794 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fd4059da0 con 0x7f8fdc0339e0 2024-09-10T09:22:45.279 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2024-09-10T09:22:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f458a7fc640 1 -- 172.21.15.12:0/165808818 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4580021080 con 0x7f458c0ced90 2024-09-10T09:22:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f021806be30 msgr2=0x7f021806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab1406bf00 msgr2=0x7fab1406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab1406bf00 0x7fab1406e3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007c90 tx=0x7fab2c007be0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f021806be30 0x7f021806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0220001a50 tx=0x7f0220000bc0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.281 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30159fb0 msgr2=0x7fab30204270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30159fb0 0x7fab30204270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab28035000 tx=0x7fab28004a40 comp rx=0 tx=0).stop 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 msgr2=0x7f022c184620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 shutdown_connections 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab1406bf00 0x7fab1406e3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab30159fb0 0x7fab30204270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab300cf180 0x7fab30155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 --2- 172.21.15.12:0/3277979448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab30070880 0x7fab3008c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 >> 172.21.15.12:0/3277979448 conn(0x7fab3006f360 msgr2=0x7fab300d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f022c184620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f022400ba50 tx=0x7f0228004730 comp rx=0 tx=0).stop 2024-09-10T09:22:45.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 shutdown_connections 2024-09-10T09:22:45.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.280+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 shutdown_connections 2024-09-10T09:22:45.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f021806be30 0x7f021806e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.280+0000 7fab3834b640 1 -- 172.21.15.12:0/3277979448 wait complete. 2024-09-10T09:22:45.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c0e4a70 0x7f022c0e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f022c04b5e0 0x7f022c0e4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 --2- 172.21.15.12:0/344549926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0224003a30 0x7f022c184620 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f022400ba50 tx=0x7f0228004730 comp rx=0 tx=0).stop 2024-09-10T09:22:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.279+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 >> 172.21.15.12:0/344549926 conn(0x7f022c036090 msgr2=0x7f022c034210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.280+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 shutdown_connections 2024-09-10T09:22:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.280+0000 7f021dffb640 1 -- 172.21.15.12:0/344549926 wait complete. 2024-09-10T09:22:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fc806be60 msgr2=0x7f8fc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fc806be60 0x7f8fc806e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009870 tx=0x7f8fe0008040 comp rx=0 tx=0).stop 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 msgr2=0x7f8fdc037a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 0x7f8fdc037a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400b3e0 tx=0x7f8fd400b8a0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 shutdown_connections 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fc806be60 0x7f8fc806e320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc0e29b0 0x7f8fdc037fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8fdc0339e0 0x7f8fdc037a90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 --2- 172.21.15.12:0/2935174794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fdc005fd0 0x7f8fdc04d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 >> 172.21.15.12:0/2935174794 conn(0x7f8fdc0360c0 msgr2=0x7f8fdc034510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.281+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 shutdown_connections 2024-09-10T09:22:45.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-10T09:22:45.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.282+0000 7f8febb3b640 1 -- 172.21.15.12:0/2935174794 wait complete. 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f457806bf00 msgr2=0x7f457806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f457806bf00 0x7f457806e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4584009fc0 tx=0x7f45840095d0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 msgr2=0x7f458c14fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 0x7f458c14fd20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f458000c440 tx=0x7f458000c900 comp rx=0 tx=0).stop 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 shutdown_connections 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f457806bf00 0x7f457806e3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f458c15eac0 0x7f458c1f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458c0ced90 0x7f458c14fd20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 --2- 172.21.15.12:0/165808818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f458c0b68d0 0x7f458c0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 >> 172.21.15.12:0/165808818 conn(0x7f458c0d11c0 msgr2=0x7f458c15dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 shutdown_connections 2024-09-10T09:22:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:45.283+0000 7f459405c640 1 -- 172.21.15.12:0/165808818 wait complete. 2024-09-10T09:22:45.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2024-09-10T09:22:45.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2024-09-10T09:22:45.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2024-09-10T09:22:45.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2024-09-10T09:22:45.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-10T09:22:45.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2024-09-10T09:22:45.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.1 2024-09-10T09:22:46.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T09:22:46.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T09:22:46.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T09:22:46.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T09:22:46.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T09:22:46.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T09:22:46.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T09:22:46.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T09:22:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.459+0000 7f85dafa1640 1 Processor -- start 2024-09-10T09:22:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.459+0000 7f66b06ac640 1 Processor -- start 2024-09-10T09:22:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.459+0000 7f66b06ac640 1 -- start start 2024-09-10T09:22:46.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66b06ac640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f66a80b6b20 0x7f66a80b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66b06ac640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f66a80b1a70 0x7f66a80b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66b06ac640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a8073eb0 con 0x7f66a80708a0 2024-09-10T09:22:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66b06ac640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f66a806d720 con 0x7f66a80b6b20 2024-09-10T09:22:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66b06ac640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f66a806cdf0 con 0x7f66a80b1a70 2024-09-10T09:22:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.460+0000 7f85dafa1640 1 -- start start 2024-09-10T09:22:46.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f85dafa1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85d406beb0 0x7f85d40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f85dafa1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85d406c290 0x7f85d40cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f85dafa1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d40b2b30 0x7f85d40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f85dafa1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f85d40b4700 con 0x7f85d406beb0 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f85dafa1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f85d40cda40 con 0x7f85d406c290 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f85dafa1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40cce30 con 0x7f85d40b2b30 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66ae448640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f66a80b6b20 0x7f66a80b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66ae448640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f66a80b6b20 0x7f66a80b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45986/0 (socket says 172.21.15.12:45986) 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66ae448640 1 -- 172.21.15.12:0/3444204782 learned_addr learned my addr 172.21.15.12:0/3444204782 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.461+0000 7f66adc47640 1 --2- 172.21.15.12:0/3444204782 >> v2:172.21.15.100:3300/0 conn(0x7f66a80b1a70 0x7f66a80b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f66ae448640 1 -- 172.21.15.12:0/3444204782 >> v2:172.21.15.100:3300/0 conn(0x7f66a80b1a70 msgr2=0x7f66a80b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f66ae448640 1 --2- 172.21.15.12:0/3444204782 >> v2:172.21.15.100:3300/0 conn(0x7f66a80b1a70 0x7f66a80b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f66ae448640 1 -- 172.21.15.12:0/3444204782 >> v1:172.21.15.100:6789/0 conn(0x7f66a80708a0 legacy=0x7f66a8070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f66ad446640 1 -- 172.21.15.12:0/3444204782 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834480010 0 0) 0x7f66a8073eb0 con 0x7f66a80708a0 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.462+0000 7f66ae448640 1 -- 172.21.15.12:0/3444204782 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a806d0d0 con 0x7f66a80b6b20 2024-09-10T09:22:46.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.463+0000 7fd408dbc640 1 Processor -- start 2024-09-10T09:22:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.463+0000 7f85d8d3d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85d406beb0 0x7f85d40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.463+0000 7f85d8d3d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85d406beb0 0x7f85d40cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46002/0 (socket says 172.21.15.12:46002) 2024-09-10T09:22:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.463+0000 7f85d8d3d640 1 -- 172.21.15.12:0/1450105125 learned_addr learned my addr 172.21.15.12:0/1450105125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.463+0000 7fd408dbc640 1 -- start start 2024-09-10T09:22:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f66ae448640 1 --2- 172.21.15.12:0/3444204782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80b6b20 0x7f66a80b6f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66a8166590 tx=0x7f669802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892a94507038764 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f66ad446640 1 -- 172.21.15.12:0/3444204782 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698037070 con 0x7f66a80b6b20 2024-09-10T09:22:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f66ad446640 1 -- 172.21.15.12:0/3444204782 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6698032440 con 0x7f66a80b6b20 2024-09-10T09:22:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7fd408dbc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd40406db70 0x7fd4040cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7fd408dbc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4040d0ce0 0x7fd404158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f85d8d3d640 1 -- 172.21.15.12:0/1450105125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d40b2b30 msgr2=0x7f85d40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f85d8d3d640 1 --2- 172.21.15.12:0/1450105125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d40b2b30 0x7f85d40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f85d8d3d640 1 -- 172.21.15.12:0/1450105125 >> v2:172.21.15.100:3300/0 conn(0x7f85d406c290 msgr2=0x7f85d40cfab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f85d8d3d640 1 --2- 172.21.15.12:0/1450105125 >> v2:172.21.15.100:3300/0 conn(0x7f85d406c290 0x7f85d40cfab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.464+0000 7f85d8d3d640 1 -- 172.21.15.12:0/1450105125 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40cd110 con 0x7f85d406beb0 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd408dbc640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40415af50 con 0x7fd40415aaf0 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd408dbc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd4040b4200 con 0x7fd4040d0ce0 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd408dbc640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd4040b56a0 con 0x7fd40406db70 2024-09-10T09:22:46.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7f66ad446640 1 -- 172.21.15.12:0/3444204782 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698032810 con 0x7f66a80b6b20 2024-09-10T09:22:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7f85d8d3d640 1 --2- 172.21.15.12:0/1450105125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d406beb0 0x7f85d40cded0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85d40cf4e0 tx=0x7f85c402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4378fc3e6a4553d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd40406db70 0x7fd4040cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd40406db70 0x7fd4040cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44434/0 (socket says 172.21.15.12:44434) 2024-09-10T09:22:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.466+0000 7f85d37fe640 1 -- 172.21.15.12:0/1450105125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4037070 con 0x7f85d406beb0 2024-09-10T09:22:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 -- 172.21.15.12:0/431877718 learned_addr learned my addr 172.21.15.12:0/431877718 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 -- 172.21.15.12:0/431877718 >> v2:172.21.15.12:3300/0 conn(0x7fd4040d0ce0 msgr2=0x7fd404158040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T09:22:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.466+0000 7f85d37fe640 1 -- 172.21.15.12:0/1450105125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c4032440 con 0x7f85d406beb0 2024-09-10T09:22:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 --2- 172.21.15.12:0/431877718 >> v2:172.21.15.12:3300/0 conn(0x7fd4040d0ce0 0x7fd404158040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 -- 172.21.15.12:0/431877718 >> v1:172.21.15.100:6789/0 conn(0x7fd40415aaf0 legacy=0x7fd4040d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.465+0000 7fd4037fe640 1 -- 172.21.15.12:0/431877718 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40415ba70 con 0x7fd40406db70 2024-09-10T09:22:46.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f66b06ac640 1 -- 172.21.15.12:0/3444204782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80b6b20 msgr2=0x7f66a80b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f66b06ac640 1 --2- 172.21.15.12:0/3444204782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80b6b20 0x7f66a80b6f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66a8166590 tx=0x7f669802a160 comp rx=0 tx=0).stop 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f66b06ac640 1 -- 172.21.15.12:0/3444204782 shutdown_connections 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f66b06ac640 1 --2- 172.21.15.12:0/3444204782 >> v2:172.21.15.100:3300/0 conn(0x7f66a80b1a70 0x7f66a80b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85d37fe640 1 -- 172.21.15.12:0/1450105125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4032810 con 0x7f85d406beb0 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 -- 172.21.15.12:0/1450105125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d406beb0 msgr2=0x7f85d40cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1450105125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d406beb0 0x7f85d40cded0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85d40cf4e0 tx=0x7f85c402a210 comp rx=0 tx=0).stop 2024-09-10T09:22:46.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f66b06ac640 1 --2- 172.21.15.12:0/3444204782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80b6b20 0x7f66a80b6f00 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66a8166590 tx=0x7f669802a160 comp rx=0 tx=0).stop 2024-09-10T09:22:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7fd4037fe640 1 --2- 172.21.15.12:0/431877718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40406db70 0x7fd4040cfa80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd404069de0 tx=0x7fd3f402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37440704c942526f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f66b06ac640 1 -- 172.21.15.12:0/3444204782 >> 172.21.15.12:0/3444204782 conn(0x7f66a80b4220 msgr2=0x7f66a80b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7fd4027fc640 1 -- 172.21.15.12:0/431877718 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4037070 con 0x7fd40406db70 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7fd4027fc640 1 -- 172.21.15.12:0/431877718 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f4032640 con 0x7fd40406db70 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7fd4027fc640 1 -- 172.21.15.12:0/431877718 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4032a50 con 0x7fd40406db70 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 -- 172.21.15.12:0/1450105125 shutdown_connections 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1450105125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d40b2b30 0x7f85d40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1450105125 >> v2:172.21.15.100:3300/0 conn(0x7f85d406c290 0x7f85d40cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1450105125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d406beb0 0x7f85d40cded0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.467+0000 7f85dafa1640 1 -- 172.21.15.12:0/1450105125 >> 172.21.15.12:0/1450105125 conn(0x7f85d40b2040 msgr2=0x7f85d40b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.468+0000 7f85dafa1640 1 -- 172.21.15.12:0/1450105125 shutdown_connections 2024-09-10T09:22:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.468+0000 7fd408dbc640 1 -- 172.21.15.12:0/431877718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40406db70 msgr2=0x7fd4040cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.468+0000 7fd408dbc640 1 --2- 172.21.15.12:0/431877718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40406db70 0x7fd4040cfa80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd404069de0 tx=0x7fd3f402a2c0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7fd408dbc640 1 -- 172.21.15.12:0/431877718 shutdown_connections 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7fd408dbc640 1 --2- 172.21.15.12:0/431877718 >> v2:172.21.15.12:3300/0 conn(0x7fd4040d0ce0 0x7fd404158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7fd408dbc640 1 --2- 172.21.15.12:0/431877718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40406db70 0x7fd4040cfa80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7fd408dbc640 1 -- 172.21.15.12:0/431877718 >> 172.21.15.12:0/431877718 conn(0x7fd40406d080 msgr2=0x7fd40406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7fd408dbc640 1 -- 172.21.15.12:0/431877718 shutdown_connections 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7fd408dbc640 1 -- 172.21.15.12:0/431877718 wait complete. 2024-09-10T09:22:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7f66b06ac640 1 -- 172.21.15.12:0/3444204782 shutdown_connections 2024-09-10T09:22:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.468+0000 7f85dafa1640 1 -- 172.21.15.12:0/1450105125 wait complete. 2024-09-10T09:22:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.470+0000 7f85dafa1640 1 Processor -- start 2024-09-10T09:22:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.471+0000 7fd408dbc640 1 Processor -- start 2024-09-10T09:22:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.471+0000 7fd408dbc640 1 -- start start 2024-09-10T09:22:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.469+0000 7f66b06ac640 1 -- 172.21.15.12:0/3444204782 wait complete. 2024-09-10T09:22:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.471+0000 7f66b06ac640 1 Processor -- start 2024-09-10T09:22:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.470+0000 7f85dafa1640 1 -- start start 2024-09-10T09:22:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.471+0000 7f85dafa1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d406beb0 0x7f85d414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.471+0000 7f85dafa1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 0x7f85d414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 0x7f85d414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 0x7f85d414e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46006/0 (socket says 172.21.15.12:46006) 2024-09-10T09:22:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85d8d3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d406beb0 0x7f85d414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85d3fff640 1 -- 172.21.15.12:0/1462615229 learned_addr learned my addr 172.21.15.12:0/1462615229 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d414bfc0 0x7f85d414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd408dbc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 0x7fd404073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd408dbc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4040d0ce0 0x7fd404144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd408dbc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40415aaf0 0x7fd404146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd408dbc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd40415b790 con 0x7fd4040d0ce0 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd408dbc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd40415b4b0 con 0x7fd40415aaf0 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd408dbc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd40415bc90 con 0x7fd40406db70 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 0x7fd404073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 0x7fd404073890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34694/0 (socket says 172.21.15.12:34694) 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7fd4037fe640 1 -- 172.21.15.12:0/3751729231 learned_addr learned my addr 172.21.15.12:0/3751729231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f66b06ac640 1 -- start start 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd402ffd640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4040d0ce0 0x7fd404144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd4037fe640 1 -- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40415aaf0 msgr2=0x7fd404146720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd4037fe640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40415aaf0 0x7fd404146720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd4037fe640 1 -- 172.21.15.12:0/3751729231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4040d0ce0 msgr2=0x7fd404144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd4037fe640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4040d0ce0 0x7fd404144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd4037fe640 1 -- 172.21.15.12:0/3751729231 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd404071de0 con 0x7fd40406db70 2024-09-10T09:22:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85d406c6d0 con 0x7f85d40b2b30 2024-09-10T09:22:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd4037fe640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 0x7fd404073890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009960 tx=0x7fd3f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40cd6d0 con 0x7f85d406beb0 2024-09-10T09:22:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.472+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f85d41584f0 con 0x7f85d414bfc0 2024-09-10T09:22:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4041070 con 0x7fd40406db70 2024-09-10T09:22:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7fd408dbc640 1 -- 172.21.15.12:0/3751729231 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4040720c0 con 0x7fd40406db70 2024-09-10T09:22:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7fd408dbc640 1 -- 172.21.15.12:0/3751729231 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4040723a0 con 0x7fd40406db70 2024-09-10T09:22:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f85d3fff640 1 -- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d414bfc0 msgr2=0x7f85d414c440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:22:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f85d3fff640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d414bfc0 0x7f85d414c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f85d3fff640 1 -- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d406beb0 msgr2=0x7f85d414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f85d3fff640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d406beb0 0x7f85d414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f85d3fff640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4147060 con 0x7f85d40b2b30 2024-09-10T09:22:46.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.473+0000 7f85d8d3d640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d406beb0 0x7f85d414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:46.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f403c950 con 0x7fd40406db70 2024-09-10T09:22:46.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4037040 con 0x7fd40406db70 2024-09-10T09:22:46.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66b06ac640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66a80708a0 0x7f66a8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66b06ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66a80b1a70 0x7f66a814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66b06ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 0x7f66a80d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66b06ac640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8162dc0 con 0x7f66a80d1210 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66b06ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8073b40 con 0x7f66a80b1a70 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66b06ac640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f66a8162f40 con 0x7f66a80708a0 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66aec49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 0x7f66a80d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66aec49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 0x7f66a80d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46016/0 (socket says 172.21.15.12:46016) 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.474+0000 7f66aec49640 1 -- 172.21.15.12:0/1068531031 learned_addr learned my addr 172.21.15.12:0/1068531031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66adc47640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66a80b1a70 0x7f66a814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66ae448640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66a80708a0 0x7f66a8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66aec49640 1 -- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66a80708a0 msgr2=0x7f66a8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66aec49640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66a80708a0 0x7f66a8159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66aec49640 1 -- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66a80b1a70 msgr2=0x7f66a814bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66aec49640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66a80b1a70 0x7f66a814bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.475+0000 7f66aec49640 1 -- 172.21.15.12:0/1068531031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a81584b0 con 0x7f66a80d1210 2024-09-10T09:22:46.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.476+0000 7f66aec49640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 0x7f66a80d16a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c780 tx=0x7f66a000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.476+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003b70 con 0x7f66a80d1210 2024-09-10T09:22:46.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.476+0000 7f85d3fff640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 0x7f85d414e3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b9b0 tx=0x7f85cc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.476+0000 7fd408dbc640 1 -- 172.21.15.12:0/3751729231 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e4005290 con 0x7fd40406db70 2024-09-10T09:22:46.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.476+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3f4044070 con 0x7fd40406db70 2024-09-10T09:22:46.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a0003d10 con 0x7f66a80d1210 2024-09-10T09:22:46.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7f66b06ac640 1 -- 172.21.15.12:0/1068531031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a8158790 con 0x7f66a80d1210 2024-09-10T09:22:46.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7f66b06ac640 1 -- 172.21.15.12:0/1068531031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a8158d50 con 0x7f66a80d1210 2024-09-10T09:22:46.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.478+0000 7f66b06ac640 1 -- 172.21.15.12:0/1068531031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a80b6f00 con 0x7f66a80d1210 2024-09-10T09:22:46.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc019070 con 0x7f85d40b2b30 2024-09-10T09:22:46.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc00cb00 con 0x7f85d40b2b30 2024-09-10T09:22:46.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.478+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc014440 con 0x7f85d40b2b30 2024-09-10T09:22:46.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7fd3ebfff640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd3f006be80 0x7fd3f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.477+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd3f40ab9b0 con 0x7fd40406db70 2024-09-10T09:22:46.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.478+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d4147340 con 0x7f85d40b2b30 2024-09-10T09:22:46.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.479+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d4147900 con 0x7f85d40b2b30 2024-09-10T09:22:46.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.481+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d40b5670 con 0x7f85d40b2b30 2024-09-10T09:22:46.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.479+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0005270 con 0x7f66a80d1210 2024-09-10T09:22:46.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.480+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66a0005410 con 0x7f66a80d1210 2024-09-10T09:22:46.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.481+0000 7f669effd640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f668c06bf00 0x7f668c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.481+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f66a008b6c0 con 0x7f66a80d1210 2024-09-10T09:22:46.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.483+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85cc01c070 con 0x7f85d40b2b30 2024-09-10T09:22:46.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.484+0000 7f85d17fa640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f85c006beb0 0x7f85c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.485+0000 7f85d8d3d640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f85c006beb0 0x7f85c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.485+0000 7f66ae448640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f668c06bf00 0x7f668c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.486+0000 7f85d8d3d640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f85c006beb0 0x7f85c006e370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85c4034000 tx=0x7f85c402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.486+0000 7f66ae448640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f668c06bf00 0x7f668c06e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6698034000 tx=0x7f669802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.481+0000 7fd402ffd640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd3f006be80 0x7fd3f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.482+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3f407a530 con 0x7fd40406db70 2024-09-10T09:22:46.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.485+0000 7fd402ffd640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd3f006be80 0x7fd3f006e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd4040cd790 tx=0x7fd3fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.489+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66a0059a00 con 0x7f66a80d1210 2024-09-10T09:22:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.497+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85cc057700 con 0x7f85d40b2b30 2024-09-10T09:22:46.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.498+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85cc059660 con 0x7f85d40b2b30 2024-09-10T09:22:46.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.515+0000 7f4d2a46e640 1 Processor -- start 2024-09-10T09:22:46.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.515+0000 7f4d2a46e640 1 -- start start 2024-09-10T09:22:46.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f5b7759e640 1 Processor -- start 2024-09-10T09:22:46.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d2a46e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d240d0ce0 0x7f4d240cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d28c6b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d240d0ce0 0x7f4d240cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d28c6b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d240d0ce0 0x7f4d240cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44490/0 (socket says 172.21.15.12:44490) 2024-09-10T09:22:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d28c6b640 1 -- 172.21.15.12:0/1281899247 learned_addr learned my addr 172.21.15.12:0/1281899247 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d240b3b10 con 0x7f4d2415aaf0 2024-09-10T09:22:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d2415ba70 con 0x7f4d241582b0 2024-09-10T09:22:46.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4d240b4200 con 0x7f4d240d0ce0 2024-09-10T09:22:46.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.517+0000 7f5b7759e640 1 -- start start 2024-09-10T09:22:46.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056861604 0 0) 0x7f4d2415ba70 con 0x7f4d241582b0 2024-09-10T09:22:46.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d10005730 con 0x7f4d241582b0 2024-09-10T09:22:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265335498 0 0) 0x7f4d1c0013c0 con 0x7f4d2415aaf0 2024-09-10T09:22:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d2415ba70 con 0x7f4d2415aaf0 2024-09-10T09:22:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f5b7759e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7000a460 0x7f5b7004f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b7759e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b70039630 con 0x7f5b70036730 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b7759e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b70039910 con 0x7f5b70054cb0 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b7759e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5b70039bf0 con 0x7f5b7000a460 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b75d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5b70036730 0x7f5b7004ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51670/0 (socket says 172.21.15.12:51670) 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b75d9b640 1 -- 172.21.15.12:0/3200416182 learned_addr learned my addr 172.21.15.12:0/3200416182 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f4d28c6b640 1 -- 172.21.15.12:0/1281899247 >> v1:172.21.15.100:6789/0 conn(0x7f4d241582b0 legacy=0x7f4d240d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f4d28c6b640 1 -- 172.21.15.12:0/1281899247 >> v1:172.21.15.12:6789/0 conn(0x7f4d2415aaf0 legacy=0x7f4d240b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f4d28c6b640 1 -- 172.21.15.12:0/1281899247 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2415b1d0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b76d9d640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7000a460 0x7f5b7004f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f84f082b640 1 Processor -- start 2024-09-10T09:22:46.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.518+0000 7f84f082b640 1 -- start start 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.519+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878446143 0 0) 0x7f5b70039910 con 0x7f5b70054cb0 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b60003520 con 0x7f5b70054cb0 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285327001 0 0) 0x7f5b70039630 con 0x7f5b70036730 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b60003880 con 0x7f5b70036730 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3780944214 0 0) 0x7f5b60003520 con 0x7f5b70054cb0 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7000a460 msgr2=0x7f5b7004f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7000a460 0x7f5b7004f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 >> v1:172.21.15.12:6789/0 conn(0x7f5b70036730 legacy=0x7f5b7004ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b70039ed0 con 0x7f5b70054cb0 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f5b680016a0 con 0x7f5b70054cb0 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 >> v1:172.21.15.100:6789/0 conn(0x7f5b70054cb0 legacy=0x7f5b70036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b60003d30 0x7f5b60004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b60004800 0x7f5b60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b60005210 0x7f5b600141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70039bf0 con 0x7f5b60003d30 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60005990 con 0x7f5b60005210 2024-09-10T09:22:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5b60005b90 con 0x7f5b60004800 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84f082b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84e40e0ac0 0x7f84e4054e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84f082b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84e4055340 0x7f84e400ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84f082b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e4053b20 con 0x7f84e40e06e0 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84f082b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f84e40333b0 con 0x7f84e40e0ac0 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84f082b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f84e400bfc0 con 0x7f84e4055340 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f5b76d9d640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b60005210 0x7f5b600141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b75d9b640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b60004800 0x7f5b60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84ea59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84e40e0ac0 0x7f84e4054e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84eb59e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84e4055340 0x7f84e400ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84ea59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84e40e0ac0 0x7f84e4054e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46020/0 (socket says 172.21.15.12:46020) 2024-09-10T09:22:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.520+0000 7f84ea59c640 1 -- 172.21.15.12:0/843028371 learned_addr learned my addr 172.21.15.12:0/843028371 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b7659c640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b60003d30 0x7f5b60004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f84eb59e640 1 -- 172.21.15.12:0/843028371 >> v2:172.21.15.12:3300/0 conn(0x7f84e40e0ac0 msgr2=0x7f84e4054e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f84eb59e640 1 --2- 172.21.15.12:0/843028371 >> v2:172.21.15.12:3300/0 conn(0x7f84e40e0ac0 0x7f84e4054e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f84eb59e640 1 -- 172.21.15.12:0/843028371 >> v1:172.21.15.12:6789/0 conn(0x7f84e40e06e0 legacy=0x7f84e40530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f84eb59e640 1 -- 172.21.15.12:0/843028371 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e400c2a0 con 0x7f84e4055340 2024-09-10T09:22:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f4d28c6b640 1 --2- 172.21.15.12:0/1281899247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d240cfa80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009400 tx=0x7f4d20005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741fe17661988f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b76d9d640 1 -- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b60004800 msgr2=0x7f5b60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b76d9d640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b60004800 0x7f5b60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b76d9d640 1 -- 172.21.15.12:0/3200416182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b60003d30 msgr2=0x7f5b60004130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b76d9d640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b60003d30 0x7f5b60004130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b76d9d640 1 -- 172.21.15.12:0/3200416182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b70039ed0 con 0x7f5b60005210 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b75d9b640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b60004800 0x7f5b60004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f5b7659c640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b60003d30 0x7f5b60004130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:46.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c001a70 con 0x7f4d240d0ce0 2024-09-10T09:22:46.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.521+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2002abe0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f4d1bfff640 1 -- 172.21.15.12:0/1281899247 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14001670 con 0x7f4d240d0ce0 2024-09-10T09:22:46.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f84eb59e640 1 --2- 172.21.15.12:0/843028371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e400ca80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84e4011000 tx=0x7f84dc02a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc950a53679213e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f906d68d640 1 Processor -- start 2024-09-10T09:22:46.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f906d68d640 1 -- start start 2024-09-10T09:22:46.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f5b76d9d640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b60005210 0x7f5b600141d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b78050d60 tx=0x7f5b60005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=659dfc57b7cd6845 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f84e9d9b640 1 -- 172.21.15.12:0/843028371 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc02abe0 con 0x7f84e4055340 2024-09-10T09:22:46.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f84e9d9b640 1 -- 172.21.15.12:0/843028371 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc02ad80 con 0x7f84e4055340 2024-09-10T09:22:46.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f84e9d9b640 1 -- 172.21.15.12:0/843028371 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00b670 con 0x7f84e4055340 2024-09-10T09:22:46.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780b3070 con 0x7f5b60005210 2024-09-10T09:22:46.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 msgr2=0x7f4d240cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.522+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/1281899247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d240cfa80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009400 tx=0x7f4d20005ec0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780a6c60 con 0x7f5b60005210 2024-09-10T09:22:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f5b7559a640 1 -- 172.21.15.12:0/3200416182 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780b3070 con 0x7f5b60005210 2024-09-10T09:22:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 shutdown_connections 2024-09-10T09:22:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/1281899247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d240cfa80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 >> 172.21.15.12:0/1281899247 conn(0x7f4d2406d080 msgr2=0x7f4d2406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 shutdown_connections 2024-09-10T09:22:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f90667fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f906806fe70 0x7f9068160050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51702/0 (socket says 172.21.15.12:51702) 2024-09-10T09:22:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.523+0000 7f906d68d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9068160760 0x7f9068158430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f90667fc640 1 -- 172.21.15.12:0/1143549592 learned_addr learned my addr 172.21.15.12:0/1143549592 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:46.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f9066ffd640 1 --1- 172.21.15.12:0/1143549592 >> v1:172.21.15.100:6789/0 conn(0x7f90680d2de0 0x7f906806f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:45008/0 (socket says 172.21.15.12:45008) 2024-09-10T09:22:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f5b7759e640 1 -- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b60005210 msgr2=0x7f5b600141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9068160c30 con 0x7f906806fe70 2024-09-10T09:22:46.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f5b7759e640 1 --2- 172.21.15.12:0/3200416182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b60005210 0x7f5b600141d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b78050d60 tx=0x7f5b60005830 comp rx=0 tx=0).stop 2024-09-10T09:22:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9068160f10 con 0x7f90680d2de0 2024-09-10T09:22:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f906815ef40 con 0x7f9068160760 2024-09-10T09:22:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f4d2a46e640 1 -- 172.21.15.12:0/1281899247 wait complete. 2024-09-10T09:22:46.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f9067fff640 1 --2- 172.21.15.12:0/1143549592 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9068160760 0x7f9068158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f5b76d9d640 1 -- 172.21.15.12:0/3200416182 reap_dead start 2024-09-10T09:22:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f5b7759e640 1 -- 172.21.15.12:0/3200416182 shutdown_connections 2024-09-10T09:22:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f5b7759e640 1 -- 172.21.15.12:0/3200416182 >> 172.21.15.12:0/3200416182 conn(0x7f5b7001d930 msgr2=0x7f5b700545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f84f082b640 1 -- 172.21.15.12:0/843028371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 msgr2=0x7f84e400ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f84f082b640 1 --2- 172.21.15.12:0/843028371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e400ca80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84e4011000 tx=0x7f84dc02a0e0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f84f082b640 1 -- 172.21.15.12:0/843028371 shutdown_connections 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f84f082b640 1 --2- 172.21.15.12:0/843028371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e400ca80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f84f082b640 1 --2- 172.21.15.12:0/843028371 >> v2:172.21.15.12:3300/0 conn(0x7f84e40e0ac0 0x7f84e4054e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f84f082b640 1 -- 172.21.15.12:0/843028371 >> 172.21.15.12:0/843028371 conn(0x7f84e401fb50 msgr2=0x7f84e4056820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.525+0000 7f84f082b640 1 -- 172.21.15.12:0/843028371 shutdown_connections 2024-09-10T09:22:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.525+0000 7f5b7759e640 1 -- 172.21.15.12:0/3200416182 shutdown_connections 2024-09-10T09:22:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.525+0000 7f84f082b640 1 -- 172.21.15.12:0/843028371 wait complete. 2024-09-10T09:22:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f9067fff640 1 -- 172.21.15.12:0/1143549592 >> v1:172.21.15.100:6789/0 conn(0x7f90680d2de0 legacy=0x7f906806f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f9067fff640 1 -- 172.21.15.12:0/1143549592 >> v1:172.21.15.12:6789/0 conn(0x7f906806fe70 legacy=0x7f9068160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.524+0000 7f9067fff640 1 -- 172.21.15.12:0/1143549592 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681611f0 con 0x7f9068160760 2024-09-10T09:22:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.525+0000 7f5b7759e640 1 -- 172.21.15.12:0/3200416182 wait complete. 2024-09-10T09:22:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.525+0000 7f4d2a46e640 1 Processor -- start 2024-09-10T09:22:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.525+0000 7f4d2a46e640 1 -- start start 2024-09-10T09:22:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f1327caf640 1 Processor -- start 2024-09-10T09:22:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f4d2a46e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d24149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f4d2a46e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d241582b0 0x7f4d240ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f4d2a46e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2415aaf0 0x7f4d240ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f4d2a46e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2415b790 con 0x7f4d2415aaf0 2024-09-10T09:22:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f4d2a46e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2415af80 con 0x7f4d240d0ce0 2024-09-10T09:22:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f4d2a46e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2415bc90 con 0x7f4d241582b0 2024-09-10T09:22:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f1327caf640 1 -- start start 2024-09-10T09:22:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d2946c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d24149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d2946c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d24149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44512/0 (socket says 172.21.15.12:44512) 2024-09-10T09:22:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d2946c640 1 -- 172.21.15.12:0/857695270 learned_addr learned my addr 172.21.15.12:0/857695270 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d29c6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2415aaf0 0x7f4d240ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f5b7759e640 1 Processor -- start 2024-09-10T09:22:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d2946c640 1 -- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d241582b0 msgr2=0x7f4d240ad4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:22:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d2946c640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d241582b0 0x7f4d240ad4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f4d2946c640 1 -- 172.21.15.12:0/857695270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2415aaf0 msgr2=0x7f4d240ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f9067fff640 1 --2- 172.21.15.12:0/1143549592 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9068160760 0x7f9068158430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90580097d0 tx=0x7f905802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebce787b5159ca37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f4d2946c640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2415aaf0 0x7f4d240ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f4d2946c640 1 -- 172.21.15.12:0/857695270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d240731f0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.526+0000 7f9065ffb640 1 -- 172.21.15.12:0/1143549592 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058037070 con 0x7f9068160760 2024-09-10T09:22:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f9065ffb640 1 -- 172.21.15.12:0/1143549592 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f905802ae30 con 0x7f9068160760 2024-09-10T09:22:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f4d29c6d640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2415aaf0 0x7f4d240ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f84f082b640 1 Processor -- start 2024-09-10T09:22:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f84f082b640 1 -- start start 2024-09-10T09:22:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.527+0000 7f9065ffb640 1 -- 172.21.15.12:0/1143549592 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058032640 con 0x7f9068160760 2024-09-10T09:22:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9068160760 msgr2=0x7f9068158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 --2- 172.21.15.12:0/1143549592 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9068160760 0x7f9068158430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90580097d0 tx=0x7f905802a1a0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 shutdown_connections 2024-09-10T09:22:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 --2- 172.21.15.12:0/1143549592 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9068160760 0x7f9068158430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 >> 172.21.15.12:0/1143549592 conn(0x7f9068073a40 msgr2=0x7f906809ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 shutdown_connections 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f906d68d640 1 -- 172.21.15.12:0/1143549592 wait complete. 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f4d2946c640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d24149af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c730 tx=0x7f4d1400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f84f082b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e40dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f84f082b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84e40e06e0 0x7f84e40e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f84f082b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e40e0ac0 0x7f84e403b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f84f082b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4054610 con 0x7f84e40e0ac0 2024-09-10T09:22:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f84f082b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40537b0 con 0x7f84e4055340 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f84f082b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f84e400cfc0 con 0x7f84e40e06e0 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400ce40 con 0x7f4d240d0ce0 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84ead9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e40dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84ead9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e40dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44532/0 (socket says 172.21.15.12:44532) 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84ead9d640 1 -- 172.21.15.12:0/3184387846 learned_addr learned my addr 172.21.15.12:0/3184387846 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84ea59c640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84e40e06e0 0x7f84e40e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84eb59e640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e40e0ac0 0x7f84e403b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f5b7759e640 1 -- start start 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f5b7759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b700cb0c0 0x7f5b700df320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f5b7759e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 0x7f5b70006050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f5b7759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006590 0x7f5b700321e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f5b7759e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70055330 con 0x7f5b700cb0c0 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f5b7759e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b700551b0 con 0x7f5b70006590 2024-09-10T09:22:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f5b7759e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5b700e0e10 con 0x7f5b7004e270 2024-09-10T09:22:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84eb59e640 1 -- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84e40e06e0 msgr2=0x7f84e40e18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84eb59e640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84e40e06e0 0x7f84e40e18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84eb59e640 1 -- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 msgr2=0x7f84e40dd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84eb59e640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e40dd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f84eb59e640 1 -- 172.21.15.12:0/3184387846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e40e2a60 con 0x7f84e40e0ac0 2024-09-10T09:22:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d240ab000 con 0x7f4d240d0ce0 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f1327caf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13180e3640 0x7f1318052ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f1327caf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180328b0 con 0x7f131801db30 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f1327caf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1318052770 con 0x7f13180520e0 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f1327caf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1318052550 con 0x7f13180e3640 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f1325a4b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f131801db30 0x7f1318050090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51704/0 (socket says 172.21.15.12:51704) 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f1325a4b640 1 -- 172.21.15.12:0/444092320 learned_addr learned my addr 172.21.15.12:0/444092320 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.528+0000 7f132624c640 1 --2- 172.21.15.12:0/444092320 >> v2:172.21.15.100:3300/0 conn(0x7f13180e3640 0x7f1318052ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f132624c640 1 -- 172.21.15.12:0/444092320 >> v1:172.21.15.100:6789/0 conn(0x7f13180520e0 legacy=0x7f13180321a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f132624c640 1 -- 172.21.15.12:0/444092320 >> v1:172.21.15.12:6789/0 conn(0x7f131801db30 legacy=0x7f1318050090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.529+0000 7f132624c640 1 -- 172.21.15.12:0/444092320 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131804f5b0 con 0x7f13180e3640 2024-09-10T09:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f5b75d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 0x7f5b70006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006590 0x7f5b700321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f5b75d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 0x7f5b70006050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34736/0 (socket says 172.21.15.12:34736) 2024-09-10T09:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f5b75d9b640 1 -- 172.21.15.12:0/1819127940 learned_addr learned my addr 172.21.15.12:0/1819127940 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f132624c640 1 --2- 172.21.15.12:0/444092320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180e3640 0x7f1318052ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f132006a3e0 tx=0x7f132006b1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ee665d0b4b8501 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f5b7659c640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b700cb0c0 0x7f5b700df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f906d68d640 1 Processor -- start 2024-09-10T09:22:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d240ab5c0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1400a640 con 0x7f4d240d0ce0 2024-09-10T09:22:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400aa30 con 0x7f4d240d0ce0 2024-09-10T09:22:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f84eb59e640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e40e0ac0 0x7f84e403b5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84dc030000 tx=0x7f84dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc041020 con 0x7f84e40e0ac0 2024-09-10T09:22:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.530+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc03c450 con 0x7f84e40e0ac0 2024-09-10T09:22:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc03c840 con 0x7f84e40e0ac0 2024-09-10T09:22:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f1324a49640 1 -- 172.21.15.12:0/444092320 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13200bc070 con 0x7f13180e3640 2024-09-10T09:22:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f906d68d640 1 -- start start 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f1324a49640 1 -- 172.21.15.12:0/444092320 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13200b47b0 con 0x7f13180e3640 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f1324a49640 1 -- 172.21.15.12:0/444092320 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13200b4ba0 con 0x7f13180e3640 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 -- 172.21.15.12:0/444092320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180e3640 msgr2=0x7f1318052ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 --2- 172.21.15.12:0/444092320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180e3640 0x7f1318052ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f132006a3e0 tx=0x7f132006b1c0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 -- 172.21.15.12:0/444092320 shutdown_connections 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 --2- 172.21.15.12:0/444092320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180e3640 0x7f1318052ac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 -- 172.21.15.12:0/444092320 >> 172.21.15.12:0/444092320 conn(0x7f1318036090 msgr2=0x7f13180364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 -- 172.21.15.12:0/444092320 shutdown_connections 2024-09-10T09:22:46.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f1327caf640 1 -- 172.21.15.12:0/444092320 wait complete. 2024-09-10T09:22:46.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e40e21c0 con 0x7f84e40e0ac0 2024-09-10T09:22:46.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e40e2780 con 0x7f84e40e0ac0 2024-09-10T09:22:46.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d04005290 con 0x7f4d240d0ce0 2024-09-10T09:22:46.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d1400abd0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f906d68d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f906806fe70 0x7f90681f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f906d68d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 0x7f90681499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f906d68d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068160760 0x7f9068149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f906d68d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90680d31c0 con 0x7f90680d2de0 2024-09-10T09:22:46.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.532+0000 7f906d68d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90681617b0 con 0x7f9068160760 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.534+0000 7f4d19ffb640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d0806bf30 0x7f4d0806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f906d68d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9068161cb0 con 0x7f906806fe70 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 0x7f90681499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 0x7f90681499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46062/0 (socket says 172.21.15.12:46062) 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 -- 172.21.15.12:0/281604222 learned_addr learned my addr 172.21.15.12:0/281604222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 -- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f906806fe70 msgr2=0x7f90681f3fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:22:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f906806fe70 0x7f90681f3fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 -- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068160760 msgr2=0x7f9068149f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:22:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068160760 0x7f9068149f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.533+0000 7f90667fc640 1 -- 172.21.15.12:0/281604222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906815ad30 con 0x7f90680d2de0 2024-09-10T09:22:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.534+0000 7f4d28c6b640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d0806bf30 0x7f4d0806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.534+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4d1408b130 con 0x7f4d240d0ce0 2024-09-10T09:22:46.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.534+0000 7f1327caf640 1 Processor -- start 2024-09-10T09:22:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.534+0000 7f90667fc640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 0x7f90681499f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f906000caf0 tx=0x7f9060002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060018070 con 0x7f90680d2de0 2024-09-10T09:22:46.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f1327caf640 1 -- start start 2024-09-10T09:22:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f5b75d9b640 1 -- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006590 msgr2=0x7f5b700321e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f5b75d9b640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006590 0x7f5b700321e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.531+0000 7f5b75d9b640 1 -- 172.21.15.12:0/1819127940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b700cb0c0 msgr2=0x7f5b700df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906000a760 con 0x7f90680d2de0 2024-09-10T09:22:46.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f5b75d9b640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b700cb0c0 0x7f5b700df320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f5b75d9b640 1 -- 172.21.15.12:0/1819127940 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b700e10b0 con 0x7f5b7004e270 2024-09-10T09:22:46.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f5b7659c640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b700cb0c0 0x7f5b700df320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:46.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.534+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e400ca80 con 0x7f84e40e0ac0 2024-09-10T09:22:46.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90680c7a20 con 0x7f90680d2de0 2024-09-10T09:22:46.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f4d28c6b640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d0806bf30 0x7f4d0806e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d20032000 tx=0x7f4d2002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9068147b70 con 0x7f90680d2de0 2024-09-10T09:22:46.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.535+0000 7f5b75d9b640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 0x7f5b70006050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0072e0 tx=0x7f5b6c0077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f1327caf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 0x7f13181888d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f1327caf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180520e0 0x7f131804db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f1327caf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13180e3640 0x7f1318189030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f1327caf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13180e3a50 con 0x7f13180e3640 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f1327caf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f131804fb70 con 0x7f13180520e0 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f1327caf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f131804f1d0 con 0x7f131801db30 2024-09-10T09:22:46.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00f9c0 con 0x7f5b7004e270 2024-09-10T09:22:46.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f5b7759e640 1 -- 172.21.15.12:0/1819127940 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b700e1390 con 0x7f5b7004e270 2024-09-10T09:22:46.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f5b7759e640 1 -- 172.21.15.12:0/1819127940 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b700e1950 con 0x7f5b7004e270 2024-09-10T09:22:46.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 0x7f13181888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 0x7f13181888d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:34738/0 (socket says 172.21.15.12:34738) 2024-09-10T09:22:46.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 -- 172.21.15.12:0/2204884075 learned_addr learned my addr 172.21.15.12:0/2204884075 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:46.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f132524a640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180520e0 0x7f131804db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84dc044020 con 0x7f84e40e0ac0 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f84d37fe640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f84d806be30 0x7f84d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 -- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180520e0 msgr2=0x7f131804db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180520e0 0x7f131804db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 -- 172.21.15.12:0/2204884075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13180e3640 msgr2=0x7f1318189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13180e3640 0x7f1318189030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 -- 172.21.15.12:0/2204884075 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13181868c0 con 0x7f131801db30 2024-09-10T09:22:46.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f1325a4b640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 0x7f13181888d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c3c0 tx=0x7f131c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.537+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84dc0ab570 con 0x7f84e40e0ac0 2024-09-10T09:22:46.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906000ab30 con 0x7f90680d2de0 2024-09-10T09:22:46.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.536+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9068147990 con 0x7f90680d2de0 2024-09-10T09:22:46.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.538+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c018070 con 0x7f5b7004e270 2024-09-10T09:22:46.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.538+0000 7f84ead9d640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f84d806be30 0x7f84d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.538+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00fd60 con 0x7f5b7004e270 2024-09-10T09:22:46.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.538+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f906001b070 con 0x7f90680d2de0 2024-09-10T09:22:46.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.539+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d14059ac0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.538+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c017070 con 0x7f131801db30 2024-09-10T09:22:46.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.539+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b70039630 con 0x7f5b7004e270 2024-09-10T09:22:46.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.539+0000 7f84ead9d640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f84d806be30 0x7f84d806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84ec050d60 tx=0x7f84ec06e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.538+0000 7f904f7fe640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f905406be80 0x7f905406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.539+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f906008a920 con 0x7f90680d2de0 2024-09-10T09:22:46.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.540+0000 7f9066ffd640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f905406be80 0x7f905406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.540+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b6c01d460 con 0x7f5b7004e270 2024-09-10T09:22:46.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.539+0000 7f1327caf640 1 -- 172.21.15.12:0/2204884075 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131804c240 con 0x7f131801db30 2024-09-10T09:22:46.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.539+0000 7f1327caf640 1 -- 172.21.15.12:0/2204884075 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f131804c800 con 0x7f131801db30 2024-09-10T09:22:46.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.540+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c0074e0 con 0x7f131801db30 2024-09-10T09:22:46.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.540+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0059a0 con 0x7f131801db30 2024-09-10T09:22:46.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.541+0000 7f5b66ffd640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5b5806bf00 0x7f5b5806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.541+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b6c08aee0 con 0x7f5b7004e270 2024-09-10T09:22:46.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.542+0000 7f5b7659c640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5b5806bf00 0x7f5b5806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.542+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f131c01a070 con 0x7f131801db30 2024-09-10T09:22:46.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.540+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13180321a0 con 0x7f131801db30 2024-09-10T09:22:46.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.542+0000 7f9066ffd640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f905406be80 0x7f905406e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f905c001570 tx=0x7f905c0079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.542+0000 7f5b7659c640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5b5806bf00 0x7f5b5806e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b68001690 tx=0x7f5b68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.542+0000 7f13127fc640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f130406be80 0x7f130406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.543+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f131c089f90 con 0x7f131801db30 2024-09-10T09:22:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.543+0000 7f132524a640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f130406be80 0x7f130406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.543+0000 7f132524a640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f130406be80 0x7f130406e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f131804e7a0 tx=0x7f1314009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:46.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.546+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b6c059930 con 0x7f5b7004e270 2024-09-10T09:22:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.547+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9068147990 con 0x7f90680d2de0 2024-09-10T09:22:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.551+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84dc04b030 con 0x7f84e40e0ac0 2024-09-10T09:22:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.552+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f131c0583d0 con 0x7f131801db30 2024-09-10T09:22:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.881+0000 7fd408dbc640 1 -- 172.21.15.12:0/3751729231 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd3e4005580 con 0x7fd40406db70 2024-09-10T09:22:46.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.882+0000 7fd3ebfff640 1 -- 172.21.15.12:0/3751729231 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3f4079e30 con 0x7fd40406db70 2024-09-10T09:22:46.882 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.885+0000 7fd3e9ffb640 1 -- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd3f006be80 msgr2=0x7fd3f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.885+0000 7fd3e9ffb640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd3f006be80 0x7fd3f006e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd4040cd790 tx=0x7fd3fc009040 comp rx=0 tx=0).stop 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.885+0000 7fd3e9ffb640 1 -- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 msgr2=0x7fd404073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.885+0000 7fd3e9ffb640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 0x7fd404073890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009960 tx=0x7fd3f40046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 -- 172.21.15.12:0/3751729231 shutdown_connections 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd3f006be80 0x7fd3f006e340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40415aaf0 0x7fd404146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4040d0ce0 0x7fd404144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 --2- 172.21.15.12:0/3751729231 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd40406db70 0x7fd404073890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 -- 172.21.15.12:0/3751729231 >> 172.21.15.12:0/3751729231 conn(0x7fd40406d080 msgr2=0x7fd404147850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 -- 172.21.15.12:0/3751729231 shutdown_connections 2024-09-10T09:22:46.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.886+0000 7fd3e9ffb640 1 -- 172.21.15.12:0/3751729231 wait complete. 2024-09-10T09:22:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.897+0000 7f66b06ac640 1 -- 172.21.15.12:0/1068531031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f66a8160800 con 0x7f66a80d1210 2024-09-10T09:22:46.898 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.898+0000 7f669effd640 1 -- 172.21.15.12:0/1068531031 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66a005dd00 con 0x7f66a80d1210 2024-09-10T09:22:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 -- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f668c06bf00 msgr2=0x7f668c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f668c06bf00 0x7f668c06e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6698034000 tx=0x7f669802e000 comp rx=0 tx=0).stop 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 -- 172.21.15.12:0/1068531031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 msgr2=0x7f66a80d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 0x7f66a80d16a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c780 tx=0x7f66a000cb80 comp rx=0 tx=0).stop 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 -- 172.21.15.12:0/1068531031 shutdown_connections 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f668c06bf00 0x7f668c06e3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66a80d1210 0x7f66a80d16a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66a80b1a70 0x7f66a814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 --2- 172.21.15.12:0/1068531031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66a80708a0 0x7f66a8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.902+0000 7f669cff9640 1 -- 172.21.15.12:0/1068531031 >> 172.21.15.12:0/1068531031 conn(0x7f66a80b4220 msgr2=0x7f66a81600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.903+0000 7f669cff9640 1 -- 172.21.15.12:0/1068531031 shutdown_connections 2024-09-10T09:22:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.903+0000 7f669cff9640 1 -- 172.21.15.12:0/1068531031 wait complete. 2024-09-10T09:22:46.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-10T09:22:46.906 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.910+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f85d415ca00 con 0x7f85d40b2b30 2024-09-10T09:22:46.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.911+0000 7f85d17fa640 1 -- 172.21.15.12:0/1462615229 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85cc05d960 con 0x7f85d40b2b30 2024-09-10T09:22:46.912 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.914+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f85c006beb0 msgr2=0x7f85c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.914+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f85c006beb0 0x7f85c006e370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85c4034000 tx=0x7f85c402e000 comp rx=0 tx=0).stop 2024-09-10T09:22:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.914+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 msgr2=0x7f85d414e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.914+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 0x7f85d414e3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b9b0 tx=0x7f85cc00be70 comp rx=0 tx=0).stop 2024-09-10T09:22:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 shutdown_connections 2024-09-10T09:22:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f85c006beb0 0x7f85c006e370 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f85d414bfc0 0x7f85d414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85d40b2b30 0x7f85d414e3f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 --2- 172.21.15.12:0/1462615229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85d406beb0 0x7f85d414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 >> 172.21.15.12:0/1462615229 conn(0x7f85d40b2040 msgr2=0x7f85d40af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 shutdown_connections 2024-09-10T09:22:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.915+0000 7f85dafa1640 1 -- 172.21.15.12:0/1462615229 wait complete. 2024-09-10T09:22:46.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-09-10T09:22:46.918 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-09-10T09:22:46.928 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.930+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1318036e50 con 0x7f131801db30 2024-09-10T09:22:46.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.931+0000 7f13127fc640 1 -- 172.21.15.12:0/2204884075 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f131c05c6d0 con 0x7f131801db30 2024-09-10T09:22:46.931 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f130406be80 msgr2=0x7f130406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f130406be80 0x7f130406e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f131804e7a0 tx=0x7f1314009040 comp rx=0 tx=0).stop 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 msgr2=0x7f13181888d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 0x7f13181888d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c3c0 tx=0x7f131c00c880 comp rx=0 tx=0).stop 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 shutdown_connections 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f130406be80 0x7f130406e340 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f131804e7a0 tx=0x7f1314009040 comp rx=0 tx=0).stop 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13180e3640 0x7f1318189030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13180520e0 0x7f131804db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 --2- 172.21.15.12:0/2204884075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131801db30 0x7f13181888d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 >> 172.21.15.12:0/2204884075 conn(0x7f1318036090 msgr2=0x7f13180deb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 shutdown_connections 2024-09-10T09:22:46.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.933+0000 7f130bfff640 1 -- 172.21.15.12:0/2204884075 wait complete. 2024-09-10T09:22:46.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-09-10T09:22:46.944 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.945+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4d04005580 con 0x7f4d240d0ce0 2024-09-10T09:22:46.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.946+0000 7f4d19ffb640 1 -- 172.21.15.12:0/857695270 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d140593c0 con 0x7f4d240d0ce0 2024-09-10T09:22:46.946 INFO:teuthology.orchestra.run.smithi012.stdout:60129542149 2024-09-10T09:22:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d0806bf30 msgr2=0x7f4d0806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d0806bf30 0x7f4d0806e3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d20032000 tx=0x7f4d2002e000 comp rx=0 tx=0).stop 2024-09-10T09:22:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 msgr2=0x7f4d24149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d24149af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c730 tx=0x7f4d1400cbf0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 shutdown_connections 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d0806bf30 0x7f4d0806e3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2415aaf0 0x7f4d240ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d241582b0 0x7f4d240ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 --2- 172.21.15.12:0/857695270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d240d0ce0 0x7f4d24149af0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 >> 172.21.15.12:0/857695270 conn(0x7f4d2406d080 msgr2=0x7f4d240ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 shutdown_connections 2024-09-10T09:22:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.949+0000 7f4d2a46e640 1 -- 172.21.15.12:0/857695270 wait complete. 2024-09-10T09:22:46.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.958+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5b700008d0 con 0x7f5b7004e270 2024-09-10T09:22:46.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.958+0000 7f5b66ffd640 1 -- 172.21.15.12:0/1819127940 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b6c059230 con 0x7f5b7004e270 2024-09-10T09:22:46.959 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:46.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5b5806bf00 msgr2=0x7f5b5806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5b5806bf00 0x7f5b5806e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b68001690 tx=0x7f5b68009040 comp rx=0 tx=0).stop 2024-09-10T09:22:46.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 msgr2=0x7f5b70006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 0x7f5b70006050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0072e0 tx=0x7f5b6c0077a0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 shutdown_connections 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5b5806bf00 0x7f5b5806e3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006590 0x7f5b700321e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5b7004e270 0x7f5b70006050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 --2- 172.21.15.12:0/1819127940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b700cb0c0 0x7f5b700df320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 >> 172.21.15.12:0/1819127940 conn(0x7f5b7001d930 msgr2=0x7f5b70033dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 shutdown_connections 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.961+0000 7f5b64ff9640 1 -- 172.21.15.12:0/1819127940 wait complete. 2024-09-10T09:22:46.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.963+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f90680c7f40 con 0x7f90680d2de0 2024-09-10T09:22:46.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-10T09:22:46.964 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.966+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f84e40ded80 con 0x7f84e40e0ac0 2024-09-10T09:22:46.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.967+0000 7f904f7fe640 1 -- 172.21.15.12:0/281604222 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9060022080 con 0x7f90680d2de0 2024-09-10T09:22:46.967 INFO:teuthology.orchestra.run.smithi012.stdout:60129542150 2024-09-10T09:22:46.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.967+0000 7f84d37fe640 1 -- 172.21.15.12:0/3184387846 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84dc0a9e20 con 0x7f84e40e0ac0 2024-09-10T09:22:46.968 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f905406be80 msgr2=0x7f905406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f905406be80 0x7f905406e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f905c001570 tx=0x7f905c0079c0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 msgr2=0x7f90681499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 0x7f90681499f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f906000caf0 tx=0x7f9060002160 comp rx=0 tx=0).stop 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 shutdown_connections 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f905406be80 0x7f905406e340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9068160760 0x7f9068149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90680d2de0 0x7f90681499f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 --2- 172.21.15.12:0/281604222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f906806fe70 0x7f90681f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 >> 172.21.15.12:0/281604222 conn(0x7f9068073a40 msgr2=0x7f90680d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f84d806be30 msgr2=0x7f84d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f84d806be30 0x7f84d806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84ec050d60 tx=0x7f84ec06e040 comp rx=0 tx=0).stop 2024-09-10T09:22:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e40e0ac0 msgr2=0x7f84e403b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e40e0ac0 0x7f84e403b5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84dc030000 tx=0x7f84dc0046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 shutdown_connections 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 shutdown_connections 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f84d806be30 0x7f84d806e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e40e0ac0 0x7f84e403b5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84e40e06e0 0x7f84e40e18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 --2- 172.21.15.12:0/3184387846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e4055340 0x7f84e40dd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 >> 172.21.15.12:0/3184387846 conn(0x7f84e401fb50 msgr2=0x7f84e4033b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f906d68d640 1 -- 172.21.15.12:0/281604222 wait complete. 2024-09-10T09:22:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 shutdown_connections 2024-09-10T09:22:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:46.970+0000 7f84f082b640 1 -- 172.21.15.12:0/3184387846 wait complete. 2024-09-10T09:22:46.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-10T09:22:46.976 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-10T09:22:46.984 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-10T09:22:46.984 DEBUG:teuthology.parallel:result is None 2024-09-10T09:22:46.984 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T09:22:46.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:22:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.125+0000 7f6f1a4d7640 1 Processor -- start 2024-09-10T09:22:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.125+0000 7f6f1a4d7640 1 -- start start 2024-09-10T09:22:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f1a4d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f140cf450 0x7f6f1406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f1a4d7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f140b3000 0x7f6f1406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f1a4d7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1406c690 con 0x7f6f1415c3a0 2024-09-10T09:22:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f1a4d7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140ce440 con 0x7f6f140cf450 2024-09-10T09:22:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f1a4d7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140cefc0 con 0x7f6f140b3000 2024-09-10T09:22:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f140cf450 0x7f6f1406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f140cf450 0x7f6f1406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46082/0 (socket says 172.21.15.12:46082) 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 -- 172.21.15.12:0/1969437465 learned_addr learned my addr 172.21.15.12:0/1969437465 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f18a74640 1 --2- 172.21.15.12:0/1969437465 >> v2:172.21.15.100:3300/0 conn(0x7f6f140b3000 0x7f6f1406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 -- 172.21.15.12:0/1969437465 >> v2:172.21.15.100:3300/0 conn(0x7f6f140b3000 msgr2=0x7f6f1406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 --2- 172.21.15.12:0/1969437465 >> v2:172.21.15.100:3300/0 conn(0x7f6f140b3000 0x7f6f1406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 -- 172.21.15.12:0/1969437465 >> v1:172.21.15.100:6789/0 conn(0x7f6f1415c3a0 legacy=0x7f6f140b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.126+0000 7f6f137fe640 1 -- 172.21.15.12:0/1969437465 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140ce690 con 0x7f6f140cf450 2024-09-10T09:22:47.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.127+0000 7f6f137fe640 1 --2- 172.21.15.12:0/1969437465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f1406bc10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f140ce5c0 tx=0x7f6f0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eabfa655edac024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.127+0000 7f6f12ffd640 1 -- 172.21.15.12:0/1969437465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08037070 con 0x7f6f140cf450 2024-09-10T09:22:47.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.127+0000 7f6f12ffd640 1 -- 172.21.15.12:0/1969437465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f08032440 con 0x7f6f140cf450 2024-09-10T09:22:47.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.127+0000 7f6f12ffd640 1 -- 172.21.15.12:0/1969437465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08032810 con 0x7f6f140cf450 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1969437465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 msgr2=0x7f6f1406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1969437465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f1406bc10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f140ce5c0 tx=0x7f6f0802a1e0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1969437465 shutdown_connections 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1969437465 >> v2:172.21.15.100:3300/0 conn(0x7f6f140b3000 0x7f6f1406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1969437465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f1406bc10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1969437465 >> 172.21.15.12:0/1969437465 conn(0x7f6f14062a80 msgr2=0x7f6f1406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1969437465 shutdown_connections 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.128+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1969437465 wait complete. 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.129+0000 7f6f1a4d7640 1 Processor -- start 2024-09-10T09:22:47.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.129+0000 7f6f1a4d7640 1 -- start start 2024-09-10T09:22:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f1a4d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f140b3000 0x7f6f14146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f1a4d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f14153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f1a4d7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f1415c3a0 0x7f6f140b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f1a4d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1415c780 con 0x7f6f140cf450 2024-09-10T09:22:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f1a4d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140cec50 con 0x7f6f140b3000 2024-09-10T09:22:47.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f1a4d7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1415c900 con 0x7f6f1415c3a0 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f14153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f14153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46084/0 (socket says 172.21.15.12:46084) 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 -- 172.21.15.12:0/1563886184 learned_addr learned my addr 172.21.15.12:0/1563886184 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f13fff640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f140b3000 0x7f6f14146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f18a74640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f1415c3a0 0x7f6f140b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 -- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f1415c3a0 msgr2=0x7f6f140b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f1415c3a0 0x7f6f140b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 -- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f140b3000 msgr2=0x7f6f14146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f140b3000 0x7f6f14146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 -- 172.21.15.12:0/1563886184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f141465a0 con 0x7f6f140cf450 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f137fe640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f14153830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f0802a220 tx=0x7f6f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08041020 con 0x7f6f140cf450 2024-09-10T09:22:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f080306c0 con 0x7f6f140cf450 2024-09-10T09:22:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.130+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08037040 con 0x7f6f140cf450 2024-09-10T09:22:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.131+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f141542b0 con 0x7f6f140cf450 2024-09-10T09:22:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.131+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f14154870 con 0x7f6f140cf450 2024-09-10T09:22:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.132+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f140b28f0 con 0x7f6f140cf450 2024-09-10T09:22:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.132+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f08044020 con 0x7f6f140cf450 2024-09-10T09:22:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.132+0000 7f6f10ff9640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0006be30 0x7f6f0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.133+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6f080ab5d0 con 0x7f6f140cf450 2024-09-10T09:22:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.133+0000 7f6f13fff640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0006be30 0x7f6f0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.133+0000 7f6f13fff640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0006be30 0x7f6f0006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f040016e0 tx=0x7f6f04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.137+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f0804b030 con 0x7f6f140cf450 2024-09-10T09:22:47.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.313+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f1406c1d0 con 0x7f6f0006be30 2024-09-10T09:22:47.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.320+0000 7f6f10ff9640 1 -- 172.21.15.12:0/1563886184 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f6f1406c1d0 con 0x7f6f0006be30 2024-09-10T09:22:47.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:47.324 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:22:47.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0006be30 msgr2=0x7f6f0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0006be30 0x7f6f0006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f040016e0 tx=0x7f6f04009040 comp rx=0 tx=0).stop 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 msgr2=0x7f6f14153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f14153830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f0802a220 tx=0x7f6f080046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 shutdown_connections 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0006be30 0x7f6f0006e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f1415c3a0 0x7f6f140b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f140cf450 0x7f6f14153830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 --2- 172.21.15.12:0/1563886184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f140b3000 0x7f6f14146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 >> 172.21.15.12:0/1563886184 conn(0x7f6f14062a80 msgr2=0x7f6f1415a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 shutdown_connections 2024-09-10T09:22:47.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.323+0000 7f6f1a4d7640 1 -- 172.21.15.12:0/1563886184 wait complete. 2024-09-10T09:22:47.335 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T09:22:47.223774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":2957312,"data_stored":1778268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.280078"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394392+0000","last_change":"2024-09-10T09:22:38.976004+0000","last_active":"2024-09-10T09:22:40.394392+0000","last_peered":"2024-09-10T09:22:40.394392+0000","last_clean":"2024-09-10T09:22:40.394392+0000","last_became_active":"2024-09-10T09:22:38.975474+0000","last_became_peered":"2024-09-10T09:22:38.975474+0000","last_unstale":"2024-09-10T09:22:40.394392+0000","last_undegraded":"2024-09-10T09:22:40.394392+0000","last_fullsized":"2024-09-10T09:22:40.394392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:24.977108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956394+0000","last_change":"2024-09-10T09:22:38.956552+0000","last_active":"2024-09-10T09:22:39.956394+0000","last_peered":"2024-09-10T09:22:39.956394+0000","last_clean":"2024-09-10T09:22:39.956394+0000","last_became_active":"2024-09-10T09:22:38.956278+0000","last_became_peered":"2024-09-10T09:22:38.956278+0000","last_unstale":"2024-09-10T09:22:39.956394+0000","last_undegraded":"2024-09-10T09:22:39.956394+0000","last_fullsized":"2024-09-10T09:22:39.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:03.584901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766351+0000","last_change":"2024-09-10T09:22:38.949199+0000","last_active":"2024-09-10T09:22:40.766351+0000","last_peered":"2024-09-10T09:22:40.766351+0000","last_clean":"2024-09-10T09:22:40.766351+0000","last_became_active":"2024-09-10T09:22:38.948874+0000","last_became_peered":"2024-09-10T09:22:38.948874+0000","last_unstale":"2024-09-10T09:22:40.766351+0000","last_undegraded":"2024-09-10T09:22:40.766351+0000","last_fullsized":"2024-09-10T09:22:40.766351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:52.643340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959878+0000","last_change":"2024-09-10T09:22:38.959631+0000","last_active":"2024-09-10T09:22:39.959878+0000","last_peered":"2024-09-10T09:22:39.959878+0000","last_clean":"2024-09-10T09:22:39.959878+0000","last_became_active":"2024-09-10T09:22:38.959224+0000","last_became_peered":"2024-09-10T09:22:38.959224+0000","last_unstale":"2024-09-10T09:22:39.959878+0000","last_undegraded":"2024-09-10T09:22:39.959878+0000","last_fullsized":"2024-09-10T09:22:39.959878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:09.259685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394013+0000","last_change":"2024-09-10T09:22:38.961515+0000","last_active":"2024-09-10T09:22:40.394013+0000","last_peered":"2024-09-10T09:22:40.394013+0000","last_clean":"2024-09-10T09:22:40.394013+0000","last_became_active":"2024-09-10T09:22:38.961173+0000","last_became_peered":"2024-09-10T09:22:38.961173+0000","last_unstale":"2024-09-10T09:22:40.394013+0000","last_undegraded":"2024-09-10T09:22:40.394013+0000","last_fullsized":"2024-09-10T09:22:40.394013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:08.149787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960116+0000","last_change":"2024-09-10T09:22:38.956333+0000","last_active":"2024-09-10T09:22:39.960116+0000","last_peered":"2024-09-10T09:22:39.960116+0000","last_clean":"2024-09-10T09:22:39.960116+0000","last_became_active":"2024-09-10T09:22:38.956056+0000","last_became_peered":"2024-09-10T09:22:38.956056+0000","last_unstale":"2024-09-10T09:22:39.960116+0000","last_undegraded":"2024-09-10T09:22:39.960116+0000","last_fullsized":"2024-09-10T09:22:39.960116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393891+0000","last_change":"2024-09-10T09:22:38.969810+0000","last_active":"2024-09-10T09:22:40.393891+0000","last_peered":"2024-09-10T09:22:40.393891+0000","last_clean":"2024-09-10T09:22:40.393891+0000","last_became_active":"2024-09-10T09:22:38.969545+0000","last_became_peered":"2024-09-10T09:22:38.969545+0000","last_unstale":"2024-09-10T09:22:40.393891+0000","last_undegraded":"2024-09-10T09:22:40.393891+0000","last_fullsized":"2024-09-10T09:22:40.393891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:26.724466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765114+0000","last_change":"2024-09-10T09:22:38.961518+0000","last_active":"2024-09-10T09:22:40.765114+0000","last_peered":"2024-09-10T09:22:40.765114+0000","last_clean":"2024-09-10T09:22:40.765114+0000","last_became_active":"2024-09-10T09:22:38.961126+0000","last_became_peered":"2024-09-10T09:22:38.961126+0000","last_unstale":"2024-09-10T09:22:40.765114+0000","last_undegraded":"2024-09-10T09:22:40.765114+0000","last_fullsized":"2024-09-10T09:22:40.765114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:02.197255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394408+0000","last_change":"2024-09-10T09:22:38.964013+0000","last_active":"2024-09-10T09:22:40.394408+0000","last_peered":"2024-09-10T09:22:40.394408+0000","last_clean":"2024-09-10T09:22:40.394408+0000","last_became_active":"2024-09-10T09:22:38.963768+0000","last_became_peered":"2024-09-10T09:22:38.963768+0000","last_unstale":"2024-09-10T09:22:40.394408+0000","last_undegraded":"2024-09-10T09:22:40.394408+0000","last_fullsized":"2024-09-10T09:22:40.394408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:22.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959958+0000","last_change":"2024-09-10T09:22:38.975261+0000","last_active":"2024-09-10T09:22:39.959958+0000","last_peered":"2024-09-10T09:22:39.959958+0000","last_clean":"2024-09-10T09:22:39.959958+0000","last_became_active":"2024-09-10T09:22:38.974086+0000","last_became_peered":"2024-09-10T09:22:38.974086+0000","last_unstale":"2024-09-10T09:22:39.959958+0000","last_undegraded":"2024-09-10T09:22:39.959958+0000","last_fullsized":"2024-09-10T09:22:39.959958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:54.998590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960092+0000","last_change":"2024-09-10T09:22:38.974707+0000","last_active":"2024-09-10T09:22:39.960092+0000","last_peered":"2024-09-10T09:22:39.960092+0000","last_clean":"2024-09-10T09:22:39.960092+0000","last_became_active":"2024-09-10T09:22:38.973755+0000","last_became_peered":"2024-09-10T09:22:38.973755+0000","last_unstale":"2024-09-10T09:22:39.960092+0000","last_undegraded":"2024-09-10T09:22:39.960092+0000","last_fullsized":"2024-09-10T09:22:39.960092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958724+0000","last_change":"2024-09-10T09:22:38.974678+0000","last_active":"2024-09-10T09:22:39.958724+0000","last_peered":"2024-09-10T09:22:39.958724+0000","last_clean":"2024-09-10T09:22:39.958724+0000","last_became_active":"2024-09-10T09:22:38.974415+0000","last_became_peered":"2024-09-10T09:22:38.974415+0000","last_unstale":"2024-09-10T09:22:39.958724+0000","last_undegraded":"2024-09-10T09:22:39.958724+0000","last_fullsized":"2024-09-10T09:22:39.958724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:09.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765854+0000","last_change":"2024-09-10T09:22:38.975398+0000","last_active":"2024-09-10T09:22:40.765854+0000","last_peered":"2024-09-10T09:22:40.765854+0000","last_clean":"2024-09-10T09:22:40.765854+0000","last_became_active":"2024-09-10T09:22:38.975093+0000","last_became_peered":"2024-09-10T09:22:38.975093+0000","last_unstale":"2024-09-10T09:22:40.765854+0000","last_undegraded":"2024-09-10T09:22:40.765854+0000","last_fullsized":"2024-09-10T09:22:40.765854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:03.584901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765481+0000","last_change":"2024-09-10T09:22:38.954877+0000","last_active":"2024-09-10T09:22:40.765481+0000","last_peered":"2024-09-10T09:22:40.765481+0000","last_clean":"2024-09-10T09:22:40.765481+0000","last_became_active":"2024-09-10T09:22:38.954549+0000","last_became_peered":"2024-09-10T09:22:38.954549+0000","last_unstale":"2024-09-10T09:22:40.765481+0000","last_undegraded":"2024-09-10T09:22:40.765481+0000","last_fullsized":"2024-09-10T09:22:40.765481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:50.063910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956131+0000","last_change":"2024-09-10T09:22:38.952469+0000","last_active":"2024-09-10T09:22:39.956131+0000","last_peered":"2024-09-10T09:22:39.956131+0000","last_clean":"2024-09-10T09:22:39.956131+0000","last_became_active":"2024-09-10T09:22:38.952191+0000","last_became_peered":"2024-09-10T09:22:38.952191+0000","last_unstale":"2024-09-10T09:22:39.956131+0000","last_undegraded":"2024-09-10T09:22:39.956131+0000","last_fullsized":"2024-09-10T09:22:39.956131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:08.191798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959960+0000","last_change":"2024-09-10T09:22:38.959740+0000","last_active":"2024-09-10T09:22:39.959960+0000","last_peered":"2024-09-10T09:22:39.959960+0000","last_clean":"2024-09-10T09:22:39.959960+0000","last_became_active":"2024-09-10T09:22:38.959256+0000","last_became_peered":"2024-09-10T09:22:38.959256+0000","last_unstale":"2024-09-10T09:22:39.959960+0000","last_undegraded":"2024-09-10T09:22:39.959960+0000","last_fullsized":"2024-09-10T09:22:39.959960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:41.583905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960546+0000","last_change":"2024-09-10T09:22:38.964925+0000","last_active":"2024-09-10T09:22:39.960546+0000","last_peered":"2024-09-10T09:22:39.960546+0000","last_clean":"2024-09-10T09:22:39.960546+0000","last_became_active":"2024-09-10T09:22:38.964232+0000","last_became_peered":"2024-09-10T09:22:38.964232+0000","last_unstale":"2024-09-10T09:22:39.960546+0000","last_undegraded":"2024-09-10T09:22:39.960546+0000","last_fullsized":"2024-09-10T09:22:39.960546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:24.977108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765763+0000","last_change":"2024-09-10T09:22:38.975406+0000","last_active":"2024-09-10T09:22:40.765763+0000","last_peered":"2024-09-10T09:22:40.765763+0000","last_clean":"2024-09-10T09:22:40.765763+0000","last_became_active":"2024-09-10T09:22:38.975079+0000","last_became_peered":"2024-09-10T09:22:38.975079+0000","last_unstale":"2024-09-10T09:22:40.765763+0000","last_undegraded":"2024-09-10T09:22:40.765763+0000","last_fullsized":"2024-09-10T09:22:40.765763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:57.060944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394390+0000","last_change":"2024-09-10T09:22:38.964857+0000","last_active":"2024-09-10T09:22:40.394390+0000","last_peered":"2024-09-10T09:22:40.394390+0000","last_clean":"2024-09-10T09:22:40.394390+0000","last_became_active":"2024-09-10T09:22:38.964560+0000","last_became_peered":"2024-09-10T09:22:38.964560+0000","last_unstale":"2024-09-10T09:22:40.394390+0000","last_undegraded":"2024-09-10T09:22:40.394390+0000","last_fullsized":"2024-09-10T09:22:40.394390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:39.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959976+0000","last_change":"2024-09-10T09:22:38.974897+0000","last_active":"2024-09-10T09:22:39.959976+0000","last_peered":"2024-09-10T09:22:39.959976+0000","last_clean":"2024-09-10T09:22:39.959976+0000","last_became_active":"2024-09-10T09:22:38.973651+0000","last_became_peered":"2024-09-10T09:22:38.973651+0000","last_unstale":"2024-09-10T09:22:39.959976+0000","last_undegraded":"2024-09-10T09:22:39.959976+0000","last_fullsized":"2024-09-10T09:22:39.959976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:52.643340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766099+0000","last_change":"2024-09-10T09:22:38.962723+0000","last_active":"2024-09-10T09:22:40.766099+0000","last_peered":"2024-09-10T09:22:40.766099+0000","last_clean":"2024-09-10T09:22:40.766099+0000","last_became_active":"2024-09-10T09:22:38.961742+0000","last_became_peered":"2024-09-10T09:22:38.961742+0000","last_unstale":"2024-09-10T09:22:40.766099+0000","last_undegraded":"2024-09-10T09:22:40.766099+0000","last_fullsized":"2024-09-10T09:22:40.766099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:13.126533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960421+0000","last_change":"2024-09-10T09:22:38.964016+0000","last_active":"2024-09-10T09:22:39.960421+0000","last_peered":"2024-09-10T09:22:39.960421+0000","last_clean":"2024-09-10T09:22:39.960421+0000","last_became_active":"2024-09-10T09:22:38.963653+0000","last_became_peered":"2024-09-10T09:22:38.963653+0000","last_unstale":"2024-09-10T09:22:39.960421+0000","last_undegraded":"2024-09-10T09:22:39.960421+0000","last_fullsized":"2024-09-10T09:22:39.960421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:43.775026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766037+0000","last_change":"2024-09-10T09:22:38.965644+0000","last_active":"2024-09-10T09:22:40.766037+0000","last_peered":"2024-09-10T09:22:40.766037+0000","last_clean":"2024-09-10T09:22:40.766037+0000","last_became_active":"2024-09-10T09:22:38.965355+0000","last_became_peered":"2024-09-10T09:22:38.965355+0000","last_unstale":"2024-09-10T09:22:40.766037+0000","last_undegraded":"2024-09-10T09:22:40.766037+0000","last_fullsized":"2024-09-10T09:22:40.766037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:39.185794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959707+0000","last_change":"2024-09-10T09:22:38.958547+0000","last_active":"2024-09-10T09:22:39.959707+0000","last_peered":"2024-09-10T09:22:39.959707+0000","last_clean":"2024-09-10T09:22:39.959707+0000","last_became_active":"2024-09-10T09:22:38.958063+0000","last_became_peered":"2024-09-10T09:22:38.958063+0000","last_unstale":"2024-09-10T09:22:39.959707+0000","last_undegraded":"2024-09-10T09:22:39.959707+0000","last_fullsized":"2024-09-10T09:22:39.959707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765558+0000","last_change":"2024-09-10T09:22:38.960259+0000","last_active":"2024-09-10T09:22:40.765558+0000","last_peered":"2024-09-10T09:22:40.765558+0000","last_clean":"2024-09-10T09:22:40.765558+0000","last_became_active":"2024-09-10T09:22:38.959749+0000","last_became_peered":"2024-09-10T09:22:38.959749+0000","last_unstale":"2024-09-10T09:22:40.765558+0000","last_undegraded":"2024-09-10T09:22:40.765558+0000","last_fullsized":"2024-09-10T09:22:40.765558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:57.616234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959747+0000","last_change":"2024-09-10T09:22:38.975027+0000","last_active":"2024-09-10T09:22:39.959747+0000","last_peered":"2024-09-10T09:22:39.959747+0000","last_clean":"2024-09-10T09:22:39.959747+0000","last_became_active":"2024-09-10T09:22:38.974540+0000","last_became_peered":"2024-09-10T09:22:38.974540+0000","last_unstale":"2024-09-10T09:22:39.959747+0000","last_undegraded":"2024-09-10T09:22:39.959747+0000","last_fullsized":"2024-09-10T09:22:39.959747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:55.420768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956226+0000","last_change":"2024-09-10T09:22:38.958133+0000","last_active":"2024-09-10T09:22:39.956226+0000","last_peered":"2024-09-10T09:22:39.956226+0000","last_clean":"2024-09-10T09:22:39.956226+0000","last_became_active":"2024-09-10T09:22:38.957783+0000","last_became_peered":"2024-09-10T09:22:38.957783+0000","last_unstale":"2024-09-10T09:22:39.956226+0000","last_undegraded":"2024-09-10T09:22:39.956226+0000","last_fullsized":"2024-09-10T09:22:39.956226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:57.616234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765919+0000","last_change":"2024-09-10T09:22:38.965849+0000","last_active":"2024-09-10T09:22:40.765919+0000","last_peered":"2024-09-10T09:22:40.765919+0000","last_clean":"2024-09-10T09:22:40.765919+0000","last_became_active":"2024-09-10T09:22:38.965247+0000","last_became_peered":"2024-09-10T09:22:38.965247+0000","last_unstale":"2024-09-10T09:22:40.765919+0000","last_undegraded":"2024-09-10T09:22:40.765919+0000","last_fullsized":"2024-09-10T09:22:40.765919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:43.411921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766324+0000","last_change":"2024-09-10T09:22:38.956629+0000","last_active":"2024-09-10T09:22:40.766324+0000","last_peered":"2024-09-10T09:22:40.766324+0000","last_clean":"2024-09-10T09:22:40.766324+0000","last_became_active":"2024-09-10T09:22:38.956335+0000","last_became_peered":"2024-09-10T09:22:38.956335+0000","last_unstale":"2024-09-10T09:22:40.766324+0000","last_undegraded":"2024-09-10T09:22:40.766324+0000","last_fullsized":"2024-09-10T09:22:40.766324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:54.998590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960500+0000","last_change":"2024-09-10T09:22:38.960158+0000","last_active":"2024-09-10T09:22:39.960500+0000","last_peered":"2024-09-10T09:22:39.960500+0000","last_clean":"2024-09-10T09:22:39.960500+0000","last_became_active":"2024-09-10T09:22:38.959580+0000","last_became_peered":"2024-09-10T09:22:38.959580+0000","last_unstale":"2024-09-10T09:22:39.960500+0000","last_undegraded":"2024-09-10T09:22:39.960500+0000","last_fullsized":"2024-09-10T09:22:39.960500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:42.311244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765707+0000","last_change":"2024-09-10T09:22:38.960529+0000","last_active":"2024-09-10T09:22:40.765707+0000","last_peered":"2024-09-10T09:22:40.765707+0000","last_clean":"2024-09-10T09:22:40.765707+0000","last_became_active":"2024-09-10T09:22:38.960209+0000","last_became_peered":"2024-09-10T09:22:38.960209+0000","last_unstale":"2024-09-10T09:22:40.765707+0000","last_undegraded":"2024-09-10T09:22:40.765707+0000","last_fullsized":"2024-09-10T09:22:40.765707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:31.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959265+0000","last_change":"2024-09-10T09:22:38.974404+0000","last_active":"2024-09-10T09:22:39.959265+0000","last_peered":"2024-09-10T09:22:39.959265+0000","last_clean":"2024-09-10T09:22:39.959265+0000","last_became_active":"2024-09-10T09:22:38.973533+0000","last_became_peered":"2024-09-10T09:22:38.973533+0000","last_unstale":"2024-09-10T09:22:39.959265+0000","last_undegraded":"2024-09-10T09:22:39.959265+0000","last_fullsized":"2024-09-10T09:22:39.959265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:07.172679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958530+0000","last_change":"2024-09-10T09:22:38.954218+0000","last_active":"2024-09-10T09:22:39.958530+0000","last_peered":"2024-09-10T09:22:39.958530+0000","last_clean":"2024-09-10T09:22:39.958530+0000","last_became_active":"2024-09-10T09:22:38.953944+0000","last_became_peered":"2024-09-10T09:22:38.953944+0000","last_unstale":"2024-09-10T09:22:39.958530+0000","last_undegraded":"2024-09-10T09:22:39.958530+0000","last_fullsized":"2024-09-10T09:22:39.958530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:51.764396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766086+0000","last_change":"2024-09-10T09:22:37.936550+0000","last_active":"2024-09-10T09:22:40.766086+0000","last_peered":"2024-09-10T09:22:40.766086+0000","last_clean":"2024-09-10T09:22:40.766086+0000","last_became_active":"2024-09-10T09:22:37.936210+0000","last_became_peered":"2024-09-10T09:22:37.936210+0000","last_unstale":"2024-09-10T09:22:40.766086+0000","last_undegraded":"2024-09-10T09:22:40.766086+0000","last_fullsized":"2024-09-10T09:22:40.766086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:23.206231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766490+0000","last_change":"2024-09-10T09:22:38.952425+0000","last_active":"2024-09-10T09:22:40.766490+0000","last_peered":"2024-09-10T09:22:40.766490+0000","last_clean":"2024-09-10T09:22:40.766490+0000","last_became_active":"2024-09-10T09:22:38.952127+0000","last_became_peered":"2024-09-10T09:22:38.952127+0000","last_unstale":"2024-09-10T09:22:40.766490+0000","last_undegraded":"2024-09-10T09:22:40.766490+0000","last_fullsized":"2024-09-10T09:22:40.766490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959522+0000","last_change":"2024-09-10T09:22:37.933314+0000","last_active":"2024-09-10T09:22:39.959522+0000","last_peered":"2024-09-10T09:22:39.959522+0000","last_clean":"2024-09-10T09:22:39.959522+0000","last_became_active":"2024-09-10T09:22:37.933023+0000","last_became_peered":"2024-09-10T09:22:37.933023+0000","last_unstale":"2024-09-10T09:22:39.959522+0000","last_undegraded":"2024-09-10T09:22:39.959522+0000","last_fullsized":"2024-09-10T09:22:39.959522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766210+0000","last_change":"2024-09-10T09:22:37.938729+0000","last_active":"2024-09-10T09:22:40.766210+0000","last_peered":"2024-09-10T09:22:40.766210+0000","last_clean":"2024-09-10T09:22:40.766210+0000","last_became_active":"2024-09-10T09:22:37.938423+0000","last_became_peered":"2024-09-10T09:22:37.938423+0000","last_unstale":"2024-09-10T09:22:40.766210+0000","last_undegraded":"2024-09-10T09:22:40.766210+0000","last_fullsized":"2024-09-10T09:22:40.766210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:49.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765295+0000","last_change":"2024-09-10T09:22:38.971494+0000","last_active":"2024-09-10T09:22:40.765295+0000","last_peered":"2024-09-10T09:22:40.765295+0000","last_clean":"2024-09-10T09:22:40.765295+0000","last_became_active":"2024-09-10T09:22:38.971139+0000","last_became_peered":"2024-09-10T09:22:38.971139+0000","last_unstale":"2024-09-10T09:22:40.765295+0000","last_undegraded":"2024-09-10T09:22:40.765295+0000","last_fullsized":"2024-09-10T09:22:40.765295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:19.609624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959768+0000","last_change":"2024-09-10T09:22:37.935606+0000","last_active":"2024-09-10T09:22:39.959768+0000","last_peered":"2024-09-10T09:22:39.959768+0000","last_clean":"2024-09-10T09:22:39.959768+0000","last_became_active":"2024-09-10T09:22:37.935277+0000","last_became_peered":"2024-09-10T09:22:37.935277+0000","last_unstale":"2024-09-10T09:22:39.959768+0000","last_undegraded":"2024-09-10T09:22:39.959768+0000","last_fullsized":"2024-09-10T09:22:39.959768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956122+0000","last_change":"2024-09-10T09:22:38.958931+0000","last_active":"2024-09-10T09:22:39.956122+0000","last_peered":"2024-09-10T09:22:39.956122+0000","last_clean":"2024-09-10T09:22:39.956122+0000","last_became_active":"2024-09-10T09:22:38.958607+0000","last_became_peered":"2024-09-10T09:22:38.958607+0000","last_unstale":"2024-09-10T09:22:39.956122+0000","last_undegraded":"2024-09-10T09:22:39.956122+0000","last_fullsized":"2024-09-10T09:22:39.956122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:19.609624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959625+0000","last_change":"2024-09-10T09:22:37.935791+0000","last_active":"2024-09-10T09:22:39.959625+0000","last_peered":"2024-09-10T09:22:39.959625+0000","last_clean":"2024-09-10T09:22:39.959625+0000","last_became_active":"2024-09-10T09:22:37.935513+0000","last_became_peered":"2024-09-10T09:22:37.935513+0000","last_unstale":"2024-09-10T09:22:39.959625+0000","last_undegraded":"2024-09-10T09:22:39.959625+0000","last_fullsized":"2024-09-10T09:22:39.959625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960442+0000","last_change":"2024-09-10T09:22:38.962591+0000","last_active":"2024-09-10T09:22:39.960442+0000","last_peered":"2024-09-10T09:22:39.960442+0000","last_clean":"2024-09-10T09:22:39.960442+0000","last_became_active":"2024-09-10T09:22:38.962315+0000","last_became_peered":"2024-09-10T09:22:38.962315+0000","last_unstale":"2024-09-10T09:22:39.960442+0000","last_undegraded":"2024-09-10T09:22:39.960442+0000","last_fullsized":"2024-09-10T09:22:39.960442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:52.288196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960253+0000","last_change":"2024-09-10T09:22:37.935382+0000","last_active":"2024-09-10T09:22:39.960253+0000","last_peered":"2024-09-10T09:22:39.960253+0000","last_clean":"2024-09-10T09:22:39.960253+0000","last_became_active":"2024-09-10T09:22:37.935104+0000","last_became_peered":"2024-09-10T09:22:37.935104+0000","last_unstale":"2024-09-10T09:22:39.960253+0000","last_undegraded":"2024-09-10T09:22:39.960253+0000","last_fullsized":"2024-09-10T09:22:39.960253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766147+0000","last_change":"2024-09-10T09:22:38.960788+0000","last_active":"2024-09-10T09:22:40.766147+0000","last_peered":"2024-09-10T09:22:40.766147+0000","last_clean":"2024-09-10T09:22:40.766147+0000","last_became_active":"2024-09-10T09:22:38.960491+0000","last_became_peered":"2024-09-10T09:22:38.960491+0000","last_unstale":"2024-09-10T09:22:40.766147+0000","last_undegraded":"2024-09-10T09:22:40.766147+0000","last_fullsized":"2024-09-10T09:22:40.766147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:55.420768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956170+0000","last_change":"2024-09-10T09:22:37.937277+0000","last_active":"2024-09-10T09:22:39.956170+0000","last_peered":"2024-09-10T09:22:39.956170+0000","last_clean":"2024-09-10T09:22:39.956170+0000","last_became_active":"2024-09-10T09:22:37.936910+0000","last_became_peered":"2024-09-10T09:22:37.936910+0000","last_unstale":"2024-09-10T09:22:39.956170+0000","last_undegraded":"2024-09-10T09:22:39.956170+0000","last_fullsized":"2024-09-10T09:22:39.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:32.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958793+0000","last_change":"2024-09-10T09:22:38.962851+0000","last_active":"2024-09-10T09:22:39.958793+0000","last_peered":"2024-09-10T09:22:39.958793+0000","last_clean":"2024-09-10T09:22:39.958793+0000","last_became_active":"2024-09-10T09:22:38.962592+0000","last_became_peered":"2024-09-10T09:22:38.962592+0000","last_unstale":"2024-09-10T09:22:39.958793+0000","last_undegraded":"2024-09-10T09:22:39.958793+0000","last_fullsized":"2024-09-10T09:22:39.958793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:43.844370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960039+0000","last_change":"2024-09-10T09:22:37.940171+0000","last_active":"2024-09-10T09:22:39.960039+0000","last_peered":"2024-09-10T09:22:39.960039+0000","last_clean":"2024-09-10T09:22:39.960039+0000","last_became_active":"2024-09-10T09:22:37.939839+0000","last_became_peered":"2024-09-10T09:22:37.939839+0000","last_unstale":"2024-09-10T09:22:39.960039+0000","last_undegraded":"2024-09-10T09:22:39.960039+0000","last_fullsized":"2024-09-10T09:22:39.960039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394148+0000","last_change":"2024-09-10T09:22:38.966134+0000","last_active":"2024-09-10T09:22:40.394148+0000","last_peered":"2024-09-10T09:22:40.394148+0000","last_clean":"2024-09-10T09:22:40.394148+0000","last_became_active":"2024-09-10T09:22:38.965850+0000","last_became_peered":"2024-09-10T09:22:38.965850+0000","last_unstale":"2024-09-10T09:22:40.394148+0000","last_undegraded":"2024-09-10T09:22:40.394148+0000","last_fullsized":"2024-09-10T09:22:40.394148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:52.288196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766436+0000","last_change":"2024-09-10T09:22:37.934809+0000","last_active":"2024-09-10T09:22:40.766436+0000","last_peered":"2024-09-10T09:22:40.766436+0000","last_clean":"2024-09-10T09:22:40.766436+0000","last_became_active":"2024-09-10T09:22:37.934290+0000","last_became_peered":"2024-09-10T09:22:37.934290+0000","last_unstale":"2024-09-10T09:22:40.766436+0000","last_undegraded":"2024-09-10T09:22:40.766436+0000","last_fullsized":"2024-09-10T09:22:40.766436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:24.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765636+0000","last_change":"2024-09-10T09:22:38.961877+0000","last_active":"2024-09-10T09:22:40.765636+0000","last_peered":"2024-09-10T09:22:40.765636+0000","last_clean":"2024-09-10T09:22:40.765636+0000","last_became_active":"2024-09-10T09:22:38.961552+0000","last_became_peered":"2024-09-10T09:22:38.961552+0000","last_unstale":"2024-09-10T09:22:40.765636+0000","last_undegraded":"2024-09-10T09:22:40.765636+0000","last_fullsized":"2024-09-10T09:22:40.765636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:17.820088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960481+0000","last_change":"2024-09-10T09:22:37.930753+0000","last_active":"2024-09-10T09:22:39.960481+0000","last_peered":"2024-09-10T09:22:39.960481+0000","last_clean":"2024-09-10T09:22:39.960481+0000","last_became_active":"2024-09-10T09:22:37.930430+0000","last_became_peered":"2024-09-10T09:22:37.930430+0000","last_unstale":"2024-09-10T09:22:39.960481+0000","last_undegraded":"2024-09-10T09:22:39.960481+0000","last_fullsized":"2024-09-10T09:22:39.960481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394076+0000","last_change":"2024-09-10T09:22:38.967848+0000","last_active":"2024-09-10T09:22:40.394076+0000","last_peered":"2024-09-10T09:22:40.394076+0000","last_clean":"2024-09-10T09:22:40.394076+0000","last_became_active":"2024-09-10T09:22:38.967573+0000","last_became_peered":"2024-09-10T09:22:38.967573+0000","last_unstale":"2024-09-10T09:22:40.394076+0000","last_undegraded":"2024-09-10T09:22:40.394076+0000","last_fullsized":"2024-09-10T09:22:40.394076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:43.775026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959289+0000","last_change":"2024-09-10T09:22:37.938173+0000","last_active":"2024-09-10T09:22:39.959289+0000","last_peered":"2024-09-10T09:22:39.959289+0000","last_clean":"2024-09-10T09:22:39.959289+0000","last_became_active":"2024-09-10T09:22:37.937876+0000","last_became_peered":"2024-09-10T09:22:37.937876+0000","last_unstale":"2024-09-10T09:22:39.959289+0000","last_undegraded":"2024-09-10T09:22:39.959289+0000","last_fullsized":"2024-09-10T09:22:39.959289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:47.182456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959422+0000","last_change":"2024-09-10T09:22:38.970503+0000","last_active":"2024-09-10T09:22:39.959422+0000","last_peered":"2024-09-10T09:22:39.959422+0000","last_clean":"2024-09-10T09:22:39.959422+0000","last_became_active":"2024-09-10T09:22:38.970224+0000","last_became_peered":"2024-09-10T09:22:38.970224+0000","last_unstale":"2024-09-10T09:22:39.959422+0000","last_undegraded":"2024-09-10T09:22:39.959422+0000","last_fullsized":"2024-09-10T09:22:39.959422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:13.126533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.764935+0000","last_change":"2024-09-10T09:22:37.933753+0000","last_active":"2024-09-10T09:22:40.764935+0000","last_peered":"2024-09-10T09:22:40.764935+0000","last_clean":"2024-09-10T09:22:40.764935+0000","last_became_active":"2024-09-10T09:22:37.933380+0000","last_became_peered":"2024-09-10T09:22:37.933380+0000","last_unstale":"2024-09-10T09:22:40.764935+0000","last_undegraded":"2024-09-10T09:22:40.764935+0000","last_fullsized":"2024-09-10T09:22:40.764935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:27.520559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393904+0000","last_change":"2024-09-10T09:22:38.962249+0000","last_active":"2024-09-10T09:22:40.393904+0000","last_peered":"2024-09-10T09:22:40.393904+0000","last_clean":"2024-09-10T09:22:40.393904+0000","last_became_active":"2024-09-10T09:22:38.961485+0000","last_became_peered":"2024-09-10T09:22:38.961485+0000","last_unstale":"2024-09-10T09:22:40.393904+0000","last_undegraded":"2024-09-10T09:22:40.393904+0000","last_fullsized":"2024-09-10T09:22:40.393904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958733+0000","last_change":"2024-09-10T09:22:37.934159+0000","last_active":"2024-09-10T09:22:39.958733+0000","last_peered":"2024-09-10T09:22:39.958733+0000","last_clean":"2024-09-10T09:22:39.958733+0000","last_became_active":"2024-09-10T09:22:37.933759+0000","last_became_peered":"2024-09-10T09:22:37.933759+0000","last_unstale":"2024-09-10T09:22:39.958733+0000","last_undegraded":"2024-09-10T09:22:39.958733+0000","last_fullsized":"2024-09-10T09:22:39.958733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.720468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394303+0000","last_change":"2024-09-10T09:22:38.961879+0000","last_active":"2024-09-10T09:22:40.394303+0000","last_peered":"2024-09-10T09:22:40.394303+0000","last_clean":"2024-09-10T09:22:40.394303+0000","last_became_active":"2024-09-10T09:22:38.961575+0000","last_became_peered":"2024-09-10T09:22:38.961575+0000","last_unstale":"2024-09-10T09:22:40.394303+0000","last_undegraded":"2024-09-10T09:22:40.394303+0000","last_fullsized":"2024-09-10T09:22:40.394303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:32.085819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765573+0000","last_change":"2024-09-10T09:22:37.933460+0000","last_active":"2024-09-10T09:22:40.765573+0000","last_peered":"2024-09-10T09:22:40.765573+0000","last_clean":"2024-09-10T09:22:40.765573+0000","last_became_active":"2024-09-10T09:22:37.933122+0000","last_became_peered":"2024-09-10T09:22:37.933122+0000","last_unstale":"2024-09-10T09:22:40.765573+0000","last_undegraded":"2024-09-10T09:22:40.765573+0000","last_fullsized":"2024-09-10T09:22:40.765573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394516+0000","last_change":"2024-09-10T09:22:38.962830+0000","last_active":"2024-09-10T09:22:40.394516+0000","last_peered":"2024-09-10T09:22:40.394516+0000","last_clean":"2024-09-10T09:22:40.394516+0000","last_became_active":"2024-09-10T09:22:38.962492+0000","last_became_peered":"2024-09-10T09:22:38.962492+0000","last_unstale":"2024-09-10T09:22:40.394516+0000","last_undegraded":"2024-09-10T09:22:40.394516+0000","last_fullsized":"2024-09-10T09:22:40.394516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:49.985776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956292+0000","last_change":"2024-09-10T09:22:37.933280+0000","last_active":"2024-09-10T09:22:39.956292+0000","last_peered":"2024-09-10T09:22:39.956292+0000","last_clean":"2024-09-10T09:22:39.956292+0000","last_became_active":"2024-09-10T09:22:37.933030+0000","last_became_peered":"2024-09-10T09:22:37.933030+0000","last_unstale":"2024-09-10T09:22:39.956292+0000","last_undegraded":"2024-09-10T09:22:39.956292+0000","last_fullsized":"2024-09-10T09:22:39.956292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:45.005434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960085+0000","last_change":"2024-09-10T09:22:38.959317+0000","last_active":"2024-09-10T09:22:39.960085+0000","last_peered":"2024-09-10T09:22:39.960085+0000","last_clean":"2024-09-10T09:22:39.960085+0000","last_became_active":"2024-09-10T09:22:38.958283+0000","last_became_peered":"2024-09-10T09:22:38.958283+0000","last_unstale":"2024-09-10T09:22:39.960085+0000","last_undegraded":"2024-09-10T09:22:39.960085+0000","last_fullsized":"2024-09-10T09:22:39.960085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:26.724466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765432+0000","last_change":"2024-09-10T09:22:37.929435+0000","last_active":"2024-09-10T09:22:40.765432+0000","last_peered":"2024-09-10T09:22:40.765432+0000","last_clean":"2024-09-10T09:22:40.765432+0000","last_became_active":"2024-09-10T09:22:37.929161+0000","last_became_peered":"2024-09-10T09:22:37.929161+0000","last_unstale":"2024-09-10T09:22:40.765432+0000","last_undegraded":"2024-09-10T09:22:40.765432+0000","last_fullsized":"2024-09-10T09:22:40.765432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394200+0000","last_change":"2024-09-10T09:22:38.964246+0000","last_active":"2024-09-10T09:22:40.394200+0000","last_peered":"2024-09-10T09:22:40.394200+0000","last_clean":"2024-09-10T09:22:40.394200+0000","last_became_active":"2024-09-10T09:22:38.964000+0000","last_became_peered":"2024-09-10T09:22:38.964000+0000","last_unstale":"2024-09-10T09:22:40.394200+0000","last_undegraded":"2024-09-10T09:22:40.394200+0000","last_fullsized":"2024-09-10T09:22:40.394200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:42.311244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393715+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:22:40.393715+0000","last_peered":"2024-09-10T09:22:40.393715+0000","last_clean":"2024-09-10T09:22:40.393715+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:22:40.393715+0000","last_undegraded":"2024-09-10T09:22:40.393715+0000","last_fullsized":"2024-09-10T09:22:40.393715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959675+0000","last_change":"2024-09-10T09:22:37.924543+0000","last_active":"2024-09-10T09:22:39.959675+0000","last_peered":"2024-09-10T09:22:39.959675+0000","last_clean":"2024-09-10T09:22:39.959675+0000","last_became_active":"2024-09-10T09:22:37.924170+0000","last_became_peered":"2024-09-10T09:22:37.924170+0000","last_unstale":"2024-09-10T09:22:39.959675+0000","last_undegraded":"2024-09-10T09:22:39.959675+0000","last_fullsized":"2024-09-10T09:22:39.959675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766370+0000","last_change":"2024-09-10T09:22:38.962024+0000","last_active":"2024-09-10T09:22:40.766370+0000","last_peered":"2024-09-10T09:22:40.766370+0000","last_clean":"2024-09-10T09:22:40.766370+0000","last_became_active":"2024-09-10T09:22:38.961394+0000","last_became_peered":"2024-09-10T09:22:38.961394+0000","last_unstale":"2024-09-10T09:22:40.766370+0000","last_undegraded":"2024-09-10T09:22:40.766370+0000","last_fullsized":"2024-09-10T09:22:40.766370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:25.333541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393609+0000","last_change":"2024-09-10T09:22:37.937745+0000","last_active":"2024-09-10T09:22:40.393609+0000","last_peered":"2024-09-10T09:22:40.393609+0000","last_clean":"2024-09-10T09:22:40.393609+0000","last_became_active":"2024-09-10T09:22:37.937135+0000","last_became_peered":"2024-09-10T09:22:37.937135+0000","last_unstale":"2024-09-10T09:22:40.393609+0000","last_undegraded":"2024-09-10T09:22:40.393609+0000","last_fullsized":"2024-09-10T09:22:40.393609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.764993+0000","last_change":"2024-09-10T09:22:38.950945+0000","last_active":"2024-09-10T09:22:40.764993+0000","last_peered":"2024-09-10T09:22:40.764993+0000","last_clean":"2024-09-10T09:22:40.764993+0000","last_became_active":"2024-09-10T09:22:38.950620+0000","last_became_peered":"2024-09-10T09:22:38.950620+0000","last_unstale":"2024-09-10T09:22:40.764993+0000","last_undegraded":"2024-09-10T09:22:40.764993+0000","last_fullsized":"2024-09-10T09:22:40.764993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.669603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765326+0000","last_change":"2024-09-10T09:22:37.932613+0000","last_active":"2024-09-10T09:22:40.765326+0000","last_peered":"2024-09-10T09:22:40.765326+0000","last_clean":"2024-09-10T09:22:40.765326+0000","last_became_active":"2024-09-10T09:22:37.932294+0000","last_became_peered":"2024-09-10T09:22:37.932294+0000","last_unstale":"2024-09-10T09:22:40.765326+0000","last_undegraded":"2024-09-10T09:22:40.765326+0000","last_fullsized":"2024-09-10T09:22:40.765326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:47.182456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956126+0000","last_change":"2024-09-10T09:22:38.953678+0000","last_active":"2024-09-10T09:22:39.956126+0000","last_peered":"2024-09-10T09:22:39.956126+0000","last_clean":"2024-09-10T09:22:39.956126+0000","last_became_active":"2024-09-10T09:22:38.953377+0000","last_became_peered":"2024-09-10T09:22:38.953377+0000","last_unstale":"2024-09-10T09:22:39.956126+0000","last_undegraded":"2024-09-10T09:22:39.956126+0000","last_fullsized":"2024-09-10T09:22:39.956126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:38.287488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960562+0000","last_change":"2024-09-10T09:22:37.933538+0000","last_active":"2024-09-10T09:22:39.960562+0000","last_peered":"2024-09-10T09:22:39.960562+0000","last_clean":"2024-09-10T09:22:39.960562+0000","last_became_active":"2024-09-10T09:22:37.933239+0000","last_became_peered":"2024-09-10T09:22:37.933239+0000","last_unstale":"2024-09-10T09:22:39.960562+0000","last_undegraded":"2024-09-10T09:22:39.960562+0000","last_fullsized":"2024-09-10T09:22:39.960562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958827+0000","last_change":"2024-09-10T09:22:38.958116+0000","last_active":"2024-09-10T09:22:39.958827+0000","last_peered":"2024-09-10T09:22:39.958827+0000","last_clean":"2024-09-10T09:22:39.958827+0000","last_became_active":"2024-09-10T09:22:38.957831+0000","last_became_peered":"2024-09-10T09:22:38.957831+0000","last_unstale":"2024-09-10T09:22:39.958827+0000","last_undegraded":"2024-09-10T09:22:39.958827+0000","last_fullsized":"2024-09-10T09:22:39.958827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:26.169482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956283+0000","last_change":"2024-09-10T09:22:37.931279+0000","last_active":"2024-09-10T09:22:39.956283+0000","last_peered":"2024-09-10T09:22:39.956283+0000","last_clean":"2024-09-10T09:22:39.956283+0000","last_became_active":"2024-09-10T09:22:37.930991+0000","last_became_peered":"2024-09-10T09:22:37.930991+0000","last_unstale":"2024-09-10T09:22:39.956283+0000","last_undegraded":"2024-09-10T09:22:39.956283+0000","last_fullsized":"2024-09-10T09:22:39.956283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:25.167130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960530+0000","last_change":"2024-09-10T09:22:38.962689+0000","last_active":"2024-09-10T09:22:39.960530+0000","last_peered":"2024-09-10T09:22:39.960530+0000","last_clean":"2024-09-10T09:22:39.960530+0000","last_became_active":"2024-09-10T09:22:38.962301+0000","last_became_peered":"2024-09-10T09:22:38.962301+0000","last_unstale":"2024-09-10T09:22:39.960530+0000","last_undegraded":"2024-09-10T09:22:39.960530+0000","last_fullsized":"2024-09-10T09:22:39.960530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:39.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394321+0000","last_change":"2024-09-10T09:22:37.936685+0000","last_active":"2024-09-10T09:22:40.394321+0000","last_peered":"2024-09-10T09:22:40.394321+0000","last_clean":"2024-09-10T09:22:40.394321+0000","last_became_active":"2024-09-10T09:22:37.936351+0000","last_became_peered":"2024-09-10T09:22:37.936351+0000","last_unstale":"2024-09-10T09:22:40.394321+0000","last_undegraded":"2024-09-10T09:22:40.394321+0000","last_fullsized":"2024-09-10T09:22:40.394321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:45.574031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956260+0000","last_change":"2024-09-10T09:22:38.953660+0000","last_active":"2024-09-10T09:22:39.956260+0000","last_peered":"2024-09-10T09:22:39.956260+0000","last_clean":"2024-09-10T09:22:39.956260+0000","last_became_active":"2024-09-10T09:22:38.953385+0000","last_became_peered":"2024-09-10T09:22:38.953385+0000","last_unstale":"2024-09-10T09:22:39.956260+0000","last_undegraded":"2024-09-10T09:22:39.956260+0000","last_fullsized":"2024-09-10T09:22:39.956260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:39.464012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956275+0000","last_change":"2024-09-10T09:22:37.935773+0000","last_active":"2024-09-10T09:22:39.956275+0000","last_peered":"2024-09-10T09:22:39.956275+0000","last_clean":"2024-09-10T09:22:39.956275+0000","last_became_active":"2024-09-10T09:22:37.934987+0000","last_became_peered":"2024-09-10T09:22:37.934987+0000","last_unstale":"2024-09-10T09:22:39.956275+0000","last_undegraded":"2024-09-10T09:22:39.956275+0000","last_fullsized":"2024-09-10T09:22:39.956275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:50.762044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765703+0000","last_change":"2024-09-10T09:22:38.967459+0000","last_active":"2024-09-10T09:22:40.765703+0000","last_peered":"2024-09-10T09:22:40.765703+0000","last_clean":"2024-09-10T09:22:40.765703+0000","last_became_active":"2024-09-10T09:22:38.967196+0000","last_became_peered":"2024-09-10T09:22:38.967196+0000","last_unstale":"2024-09-10T09:22:40.765703+0000","last_undegraded":"2024-09-10T09:22:40.765703+0000","last_fullsized":"2024-09-10T09:22:40.765703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:39.464012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959741+0000","last_change":"2024-09-10T09:22:37.933918+0000","last_active":"2024-09-10T09:22:39.959741+0000","last_peered":"2024-09-10T09:22:39.959741+0000","last_clean":"2024-09-10T09:22:39.959741+0000","last_became_active":"2024-09-10T09:22:37.933296+0000","last_became_peered":"2024-09-10T09:22:37.933296+0000","last_unstale":"2024-09-10T09:22:39.959741+0000","last_undegraded":"2024-09-10T09:22:39.959741+0000","last_fullsized":"2024-09-10T09:22:39.959741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766192+0000","last_change":"2024-09-10T09:22:38.955166+0000","last_active":"2024-09-10T09:22:40.766192+0000","last_peered":"2024-09-10T09:22:40.766192+0000","last_clean":"2024-09-10T09:22:40.766192+0000","last_became_active":"2024-09-10T09:22:38.954427+0000","last_became_peered":"2024-09-10T09:22:38.954427+0000","last_unstale":"2024-09-10T09:22:40.766192+0000","last_undegraded":"2024-09-10T09:22:40.766192+0000","last_fullsized":"2024-09-10T09:22:40.766192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:06.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393603+0000","last_change":"2024-09-10T09:22:37.937409+0000","last_active":"2024-09-10T09:22:40.393603+0000","last_peered":"2024-09-10T09:22:40.393603+0000","last_clean":"2024-09-10T09:22:40.393603+0000","last_became_active":"2024-09-10T09:22:37.937072+0000","last_became_peered":"2024-09-10T09:22:37.937072+0000","last_unstale":"2024-09-10T09:22:40.393603+0000","last_undegraded":"2024-09-10T09:22:40.393603+0000","last_fullsized":"2024-09-10T09:22:40.393603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958268+0000","last_change":"2024-09-10T09:22:38.953130+0000","last_active":"2024-09-10T09:22:39.958268+0000","last_peered":"2024-09-10T09:22:39.958268+0000","last_clean":"2024-09-10T09:22:39.958268+0000","last_became_active":"2024-09-10T09:22:38.952716+0000","last_became_peered":"2024-09-10T09:22:38.952716+0000","last_unstale":"2024-09-10T09:22:39.958268+0000","last_undegraded":"2024-09-10T09:22:39.958268+0000","last_fullsized":"2024-09-10T09:22:39.958268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:46.007786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956251+0000","last_change":"2024-09-10T09:22:37.936227+0000","last_active":"2024-09-10T09:22:39.956251+0000","last_peered":"2024-09-10T09:22:39.956251+0000","last_clean":"2024-09-10T09:22:39.956251+0000","last_became_active":"2024-09-10T09:22:37.935936+0000","last_became_peered":"2024-09-10T09:22:37.935936+0000","last_unstale":"2024-09-10T09:22:39.956251+0000","last_undegraded":"2024-09-10T09:22:39.956251+0000","last_fullsized":"2024-09-10T09:22:39.956251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:08.115626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765478+0000","last_change":"2024-09-10T09:22:38.956190+0000","last_active":"2024-09-10T09:22:40.765478+0000","last_peered":"2024-09-10T09:22:40.765478+0000","last_clean":"2024-09-10T09:22:40.765478+0000","last_became_active":"2024-09-10T09:22:38.955905+0000","last_became_peered":"2024-09-10T09:22:38.955905+0000","last_unstale":"2024-09-10T09:22:40.765478+0000","last_undegraded":"2024-09-10T09:22:40.765478+0000","last_fullsized":"2024-09-10T09:22:40.765478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:08.191798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956124+0000","last_change":"2024-09-10T09:22:37.932705+0000","last_active":"2024-09-10T09:22:39.956124+0000","last_peered":"2024-09-10T09:22:39.956124+0000","last_clean":"2024-09-10T09:22:39.956124+0000","last_became_active":"2024-09-10T09:22:37.932417+0000","last_became_peered":"2024-09-10T09:22:37.932417+0000","last_unstale":"2024-09-10T09:22:39.956124+0000","last_undegraded":"2024-09-10T09:22:39.956124+0000","last_fullsized":"2024-09-10T09:22:39.956124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:42.842018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766025+0000","last_change":"2024-09-10T09:22:38.971397+0000","last_active":"2024-09-10T09:22:40.766025+0000","last_peered":"2024-09-10T09:22:40.766025+0000","last_clean":"2024-09-10T09:22:40.766025+0000","last_became_active":"2024-09-10T09:22:38.971061+0000","last_became_peered":"2024-09-10T09:22:38.971061+0000","last_unstale":"2024-09-10T09:22:40.766025+0000","last_undegraded":"2024-09-10T09:22:40.766025+0000","last_fullsized":"2024-09-10T09:22:40.766025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:15.366046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394084+0000","last_change":"2024-09-10T09:22:37.935050+0000","last_active":"2024-09-10T09:22:40.394084+0000","last_peered":"2024-09-10T09:22:40.394084+0000","last_clean":"2024-09-10T09:22:40.394084+0000","last_became_active":"2024-09-10T09:22:37.934776+0000","last_became_peered":"2024-09-10T09:22:37.934776+0000","last_unstale":"2024-09-10T09:22:40.394084+0000","last_undegraded":"2024-09-10T09:22:40.394084+0000","last_fullsized":"2024-09-10T09:22:40.394084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:56.058592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959848+0000","last_change":"2024-09-10T09:22:38.972540+0000","last_active":"2024-09-10T09:22:39.959848+0000","last_peered":"2024-09-10T09:22:39.959848+0000","last_clean":"2024-09-10T09:22:39.959848+0000","last_became_active":"2024-09-10T09:22:38.972250+0000","last_became_peered":"2024-09-10T09:22:38.972250+0000","last_unstale":"2024-09-10T09:22:39.959848+0000","last_undegraded":"2024-09-10T09:22:39.959848+0000","last_fullsized":"2024-09-10T09:22:39.959848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:06.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960526+0000","last_change":"2024-09-10T09:22:38.969444+0000","last_active":"2024-09-10T09:22:39.960526+0000","last_peered":"2024-09-10T09:22:39.960526+0000","last_clean":"2024-09-10T09:22:39.960526+0000","last_became_active":"2024-09-10T09:22:38.968894+0000","last_became_peered":"2024-09-10T09:22:38.968894+0000","last_unstale":"2024-09-10T09:22:39.960526+0000","last_undegraded":"2024-09-10T09:22:39.960526+0000","last_fullsized":"2024-09-10T09:22:39.960526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:32.085819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393977+0000","last_change":"2024-09-10T09:22:37.935751+0000","last_active":"2024-09-10T09:22:40.393977+0000","last_peered":"2024-09-10T09:22:40.393977+0000","last_clean":"2024-09-10T09:22:40.393977+0000","last_became_active":"2024-09-10T09:22:37.935466+0000","last_became_peered":"2024-09-10T09:22:37.935466+0000","last_unstale":"2024-09-10T09:22:40.393977+0000","last_undegraded":"2024-09-10T09:22:40.393977+0000","last_fullsized":"2024-09-10T09:22:40.393977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960197+0000","last_change":"2024-09-10T09:22:38.969161+0000","last_active":"2024-09-10T09:22:39.960197+0000","last_peered":"2024-09-10T09:22:39.960197+0000","last_clean":"2024-09-10T09:22:39.960197+0000","last_became_active":"2024-09-10T09:22:38.968833+0000","last_became_peered":"2024-09-10T09:22:38.968833+0000","last_unstale":"2024-09-10T09:22:39.960197+0000","last_undegraded":"2024-09-10T09:22:39.960197+0000","last_fullsized":"2024-09-10T09:22:39.960197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:08.149787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394206+0000","last_change":"2024-09-10T09:22:37.938067+0000","last_active":"2024-09-10T09:22:40.394206+0000","last_peered":"2024-09-10T09:22:40.394206+0000","last_clean":"2024-09-10T09:22:40.394206+0000","last_became_active":"2024-09-10T09:22:37.937760+0000","last_became_peered":"2024-09-10T09:22:37.937760+0000","last_unstale":"2024-09-10T09:22:40.394206+0000","last_undegraded":"2024-09-10T09:22:40.394206+0000","last_fullsized":"2024-09-10T09:22:40.394206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:09.281127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765966+0000","last_change":"2024-09-10T09:22:38.960874+0000","last_active":"2024-09-10T09:22:40.765966+0000","last_peered":"2024-09-10T09:22:40.765966+0000","last_clean":"2024-09-10T09:22:40.765966+0000","last_became_active":"2024-09-10T09:22:38.960543+0000","last_became_peered":"2024-09-10T09:22:38.960543+0000","last_unstale":"2024-09-10T09:22:40.765966+0000","last_undegraded":"2024-09-10T09:22:40.765966+0000","last_fullsized":"2024-09-10T09:22:40.765966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:07.172679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765791+0000","last_change":"2024-09-10T09:22:37.937400+0000","last_active":"2024-09-10T09:22:40.765791+0000","last_peered":"2024-09-10T09:22:40.765791+0000","last_clean":"2024-09-10T09:22:40.765791+0000","last_became_active":"2024-09-10T09:22:37.934936+0000","last_became_peered":"2024-09-10T09:22:37.934936+0000","last_unstale":"2024-09-10T09:22:40.765791+0000","last_undegraded":"2024-09-10T09:22:40.765791+0000","last_fullsized":"2024-09-10T09:22:40.765791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:14.717544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765375+0000","last_change":"2024-09-10T09:22:38.975581+0000","last_active":"2024-09-10T09:22:40.765375+0000","last_peered":"2024-09-10T09:22:40.765375+0000","last_clean":"2024-09-10T09:22:40.765375+0000","last_became_active":"2024-09-10T09:22:38.975251+0000","last_became_peered":"2024-09-10T09:22:38.975251+0000","last_unstale":"2024-09-10T09:22:40.765375+0000","last_undegraded":"2024-09-10T09:22:40.765375+0000","last_fullsized":"2024-09-10T09:22:40.765375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:38.287488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766352+0000","last_change":"2024-09-10T09:22:37.933756+0000","last_active":"2024-09-10T09:22:40.766352+0000","last_peered":"2024-09-10T09:22:40.766352+0000","last_clean":"2024-09-10T09:22:40.766352+0000","last_became_active":"2024-09-10T09:22:37.933486+0000","last_became_peered":"2024-09-10T09:22:37.933486+0000","last_unstale":"2024-09-10T09:22:40.766352+0000","last_undegraded":"2024-09-10T09:22:40.766352+0000","last_fullsized":"2024-09-10T09:22:40.766352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:19.576934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":665039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":74179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":74089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:22:47.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:22:47.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.477+0000 7fabec178640 1 Processor -- start 2024-09-10T09:22:47.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.477+0000 7fabec178640 1 -- start start 2024-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabec178640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabe415ca40 0x7fabe415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabec178640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fabe415ceb0 0x7fabe41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabec178640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe415d390 con 0x7fabe40d02a0 2024-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabec178640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fabe415d670 con 0x7fabe415ca40 2024-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabec178640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fabe415d950 con 0x7fabe415ceb0 2024-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9713640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabe415ca40 0x7fabe415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9f14640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fabe40d02a0 0x7fabe40d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51712/0 (socket says 172.21.15.12:51712) 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9f14640 1 -- 172.21.15.12:0/2511677756 learned_addr learned my addr 172.21.15.12:0/2511677756 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9713640 1 -- 172.21.15.12:0/2511677756 >> v2:172.21.15.100:3300/0 conn(0x7fabe415ceb0 msgr2=0x7fabe41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabea715640 1 --2- 172.21.15.12:0/2511677756 >> v2:172.21.15.100:3300/0 conn(0x7fabe415ceb0 0x7fabe41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9713640 1 --2- 172.21.15.12:0/2511677756 >> v2:172.21.15.100:3300/0 conn(0x7fabe415ceb0 0x7fabe41594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe8f12640 1 -- 172.21.15.12:0/2511677756 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787256251 0 0) 0x7fabe415d390 con 0x7fabe40d02a0 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9713640 1 -- 172.21.15.12:0/2511677756 >> v1:172.21.15.12:6789/0 conn(0x7fabe40d02a0 legacy=0x7fabe40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.478+0000 7fabe9713640 1 -- 172.21.15.12:0/2511677756 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe415dc30 con 0x7fabe415ca40 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.479+0000 7fabe9713640 1 --2- 172.21.15.12:0/2511677756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe415e430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabe40b4be0 tx=0x7fabd402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71445a17b7ddcdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.479+0000 7fabe8f12640 1 -- 172.21.15.12:0/2511677756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4037070 con 0x7fabe415ca40 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.479+0000 7fabe8f12640 1 -- 172.21.15.12:0/2511677756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd4032440 con 0x7fabe415ca40 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.479+0000 7fabe8f12640 1 -- 172.21.15.12:0/2511677756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd402ae60 con 0x7fabe415ca40 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 -- 172.21.15.12:0/2511677756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 msgr2=0x7fabe415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 --2- 172.21.15.12:0/2511677756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe415e430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabe40b4be0 tx=0x7fabd402a110 comp rx=0 tx=0).stop 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 -- 172.21.15.12:0/2511677756 shutdown_connections 2024-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 --2- 172.21.15.12:0/2511677756 >> v2:172.21.15.100:3300/0 conn(0x7fabe415ceb0 0x7fabe41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 --2- 172.21.15.12:0/2511677756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe415e430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 -- 172.21.15.12:0/2511677756 >> 172.21.15.12:0/2511677756 conn(0x7fabe4062cc0 msgr2=0x7fabe406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 -- 172.21.15.12:0/2511677756 shutdown_connections 2024-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.480+0000 7fabec178640 1 -- 172.21.15.12:0/2511677756 wait complete. 2024-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.481+0000 7fabec178640 1 Processor -- start 2024-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.481+0000 7fabec178640 1 -- start start 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabec178640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabe40d02a0 0x7fabe41f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabec178640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe414ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabec178640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe415ceb0 0x7fabe40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabec178640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4155d10 con 0x7fabe415ca40 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabec178640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4155b90 con 0x7fabe415ceb0 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabec178640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fabe40b4790 con 0x7fabe40d02a0 2024-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe414ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe414ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46102/0 (socket says 172.21.15.12:46102) 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 -- 172.21.15.12:0/3256497524 learned_addr learned my addr 172.21.15.12:0/3256497524 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabea715640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe415ceb0 0x7fabe40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9f14640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabe40d02a0 0x7fabe41f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 -- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabe40d02a0 msgr2=0x7fabe41f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabe40d02a0 0x7fabe41f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 -- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe415ceb0 msgr2=0x7fabe40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe415ceb0 0x7fabe40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 -- 172.21.15.12:0/3256497524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe4158a50 con 0x7fabe415ca40 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9f14640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabe40d02a0 0x7fabe41f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabea715640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe415ceb0 0x7fabe40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.482+0000 7fabe9713640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe414ad50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabd4000c00 tx=0x7fabd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.483+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4037040 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.483+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd4042070 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.483+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe4158d30 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.483+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4030bd0 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.483+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe4155e90 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.484+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe40d0680 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.484+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabd4047460 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.485+0000 7fabda7fc640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fabc806be30 0x7fabc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.485+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fabd40aba60 con 0x7fabe415ca40 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.485+0000 7fabe9f14640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fabc806be30 0x7fabc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.486+0000 7fabe9f14640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fabc806be30 0x7fabc806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabe0000f60 tx=0x7fabe0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.489+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabd4032e20 con 0x7fabe415ca40 2024-09-10T09:22:47.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.660+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabe4158800 con 0x7fabc806be30 2024-09-10T09:22:47.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.667+0000 7fabda7fc640 1 -- 172.21.15.12:0/3256497524 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fabe4158800 con 0x7fabc806be30 2024-09-10T09:22:47.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:47.688 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:22:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fabc806be30 msgr2=0x7fabc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fabc806be30 0x7fabc806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabe0000f60 tx=0x7fabe0009040 comp rx=0 tx=0).stop 2024-09-10T09:22:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 msgr2=0x7fabe414ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe414ad50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabd4000c00 tx=0x7fabd40046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 shutdown_connections 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fabc806be30 0x7fabc806e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabe415ceb0 0x7fabe40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabe415ca40 0x7fabe414ad50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 --2- 172.21.15.12:0/3256497524 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabe40d02a0 0x7fabe41f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 >> 172.21.15.12:0/3256497524 conn(0x7fabe4062cc0 msgr2=0x7fabe40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 shutdown_connections 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.670+0000 7fabec178640 1 -- 172.21.15.12:0/3256497524 wait complete. 2024-09-10T09:22:47.691 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T09:22:47.223774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":2957312,"data_stored":1778268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.280078"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394392+0000","last_change":"2024-09-10T09:22:38.976004+0000","last_active":"2024-09-10T09:22:40.394392+0000","last_peered":"2024-09-10T09:22:40.394392+0000","last_clean":"2024-09-10T09:22:40.394392+0000","last_became_active":"2024-09-10T09:22:38.975474+0000","last_became_peered":"2024-09-10T09:22:38.975474+0000","last_unstale":"2024-09-10T09:22:40.394392+0000","last_undegraded":"2024-09-10T09:22:40.394392+0000","last_fullsized":"2024-09-10T09:22:40.394392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:24.977108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956394+0000","last_change":"2024-09-10T09:22:38.956552+0000","last_active":"2024-09-10T09:22:39.956394+0000","last_peered":"2024-09-10T09:22:39.956394+0000","last_clean":"2024-09-10T09:22:39.956394+0000","last_became_active":"2024-09-10T09:22:38.956278+0000","last_became_peered":"2024-09-10T09:22:38.956278+0000","last_unstale":"2024-09-10T09:22:39.956394+0000","last_undegraded":"2024-09-10T09:22:39.956394+0000","last_fullsized":"2024-09-10T09:22:39.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:03.584901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766351+0000","last_change":"2024-09-10T09:22:38.949199+0000","last_active":"2024-09-10T09:22:40.766351+0000","last_peered":"2024-09-10T09:22:40.766351+0000","last_clean":"2024-09-10T09:22:40.766351+0000","last_became_active":"2024-09-10T09:22:38.948874+0000","last_became_peered":"2024-09-10T09:22:38.948874+0000","last_unstale":"2024-09-10T09:22:40.766351+0000","last_undegraded":"2024-09-10T09:22:40.766351+0000","last_fullsized":"2024-09-10T09:22:40.766351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:52.643340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959878+0000","last_change":"2024-09-10T09:22:38.959631+0000","last_active":"2024-09-10T09:22:39.959878+0000","last_peered":"2024-09-10T09:22:39.959878+0000","last_clean":"2024-09-10T09:22:39.959878+0000","last_became_active":"2024-09-10T09:22:38.959224+0000","last_became_peered":"2024-09-10T09:22:38.959224+0000","last_unstale":"2024-09-10T09:22:39.959878+0000","last_undegraded":"2024-09-10T09:22:39.959878+0000","last_fullsized":"2024-09-10T09:22:39.959878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:09.259685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394013+0000","last_change":"2024-09-10T09:22:38.961515+0000","last_active":"2024-09-10T09:22:40.394013+0000","last_peered":"2024-09-10T09:22:40.394013+0000","last_clean":"2024-09-10T09:22:40.394013+0000","last_became_active":"2024-09-10T09:22:38.961173+0000","last_became_peered":"2024-09-10T09:22:38.961173+0000","last_unstale":"2024-09-10T09:22:40.394013+0000","last_undegraded":"2024-09-10T09:22:40.394013+0000","last_fullsized":"2024-09-10T09:22:40.394013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:08.149787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960116+0000","last_change":"2024-09-10T09:22:38.956333+0000","last_active":"2024-09-10T09:22:39.960116+0000","last_peered":"2024-09-10T09:22:39.960116+0000","last_clean":"2024-09-10T09:22:39.960116+0000","last_became_active":"2024-09-10T09:22:38.956056+0000","last_became_peered":"2024-09-10T09:22:38.956056+0000","last_unstale":"2024-09-10T09:22:39.960116+0000","last_undegraded":"2024-09-10T09:22:39.960116+0000","last_fullsized":"2024-09-10T09:22:39.960116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393891+0000","last_change":"2024-09-10T09:22:38.969810+0000","last_active":"2024-09-10T09:22:40.393891+0000","last_peered":"2024-09-10T09:22:40.393891+0000","last_clean":"2024-09-10T09:22:40.393891+0000","last_became_active":"2024-09-10T09:22:38.969545+0000","last_became_peered":"2024-09-10T09:22:38.969545+0000","last_unstale":"2024-09-10T09:22:40.393891+0000","last_undegraded":"2024-09-10T09:22:40.393891+0000","last_fullsized":"2024-09-10T09:22:40.393891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:26.724466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765114+0000","last_change":"2024-09-10T09:22:38.961518+0000","last_active":"2024-09-10T09:22:40.765114+0000","last_peered":"2024-09-10T09:22:40.765114+0000","last_clean":"2024-09-10T09:22:40.765114+0000","last_became_active":"2024-09-10T09:22:38.961126+0000","last_became_peered":"2024-09-10T09:22:38.961126+0000","last_unstale":"2024-09-10T09:22:40.765114+0000","last_undegraded":"2024-09-10T09:22:40.765114+0000","last_fullsized":"2024-09-10T09:22:40.765114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:02.197255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394408+0000","last_change":"2024-09-10T09:22:38.964013+0000","last_active":"2024-09-10T09:22:40.394408+0000","last_peered":"2024-09-10T09:22:40.394408+0000","last_clean":"2024-09-10T09:22:40.394408+0000","last_became_active":"2024-09-10T09:22:38.963768+0000","last_became_peered":"2024-09-10T09:22:38.963768+0000","last_unstale":"2024-09-10T09:22:40.394408+0000","last_undegraded":"2024-09-10T09:22:40.394408+0000","last_fullsized":"2024-09-10T09:22:40.394408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:22.695327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959958+0000","last_change":"2024-09-10T09:22:38.975261+0000","last_active":"2024-09-10T09:22:39.959958+0000","last_peered":"2024-09-10T09:22:39.959958+0000","last_clean":"2024-09-10T09:22:39.959958+0000","last_became_active":"2024-09-10T09:22:38.974086+0000","last_became_peered":"2024-09-10T09:22:38.974086+0000","last_unstale":"2024-09-10T09:22:39.959958+0000","last_undegraded":"2024-09-10T09:22:39.959958+0000","last_fullsized":"2024-09-10T09:22:39.959958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:54.998590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960092+0000","last_change":"2024-09-10T09:22:38.974707+0000","last_active":"2024-09-10T09:22:39.960092+0000","last_peered":"2024-09-10T09:22:39.960092+0000","last_clean":"2024-09-10T09:22:39.960092+0000","last_became_active":"2024-09-10T09:22:38.973755+0000","last_became_peered":"2024-09-10T09:22:38.973755+0000","last_unstale":"2024-09-10T09:22:39.960092+0000","last_undegraded":"2024-09-10T09:22:39.960092+0000","last_fullsized":"2024-09-10T09:22:39.960092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958724+0000","last_change":"2024-09-10T09:22:38.974678+0000","last_active":"2024-09-10T09:22:39.958724+0000","last_peered":"2024-09-10T09:22:39.958724+0000","last_clean":"2024-09-10T09:22:39.958724+0000","last_became_active":"2024-09-10T09:22:38.974415+0000","last_became_peered":"2024-09-10T09:22:38.974415+0000","last_unstale":"2024-09-10T09:22:39.958724+0000","last_undegraded":"2024-09-10T09:22:39.958724+0000","last_fullsized":"2024-09-10T09:22:39.958724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:09.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765854+0000","last_change":"2024-09-10T09:22:38.975398+0000","last_active":"2024-09-10T09:22:40.765854+0000","last_peered":"2024-09-10T09:22:40.765854+0000","last_clean":"2024-09-10T09:22:40.765854+0000","last_became_active":"2024-09-10T09:22:38.975093+0000","last_became_peered":"2024-09-10T09:22:38.975093+0000","last_unstale":"2024-09-10T09:22:40.765854+0000","last_undegraded":"2024-09-10T09:22:40.765854+0000","last_fullsized":"2024-09-10T09:22:40.765854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:03.584901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765481+0000","last_change":"2024-09-10T09:22:38.954877+0000","last_active":"2024-09-10T09:22:40.765481+0000","last_peered":"2024-09-10T09:22:40.765481+0000","last_clean":"2024-09-10T09:22:40.765481+0000","last_became_active":"2024-09-10T09:22:38.954549+0000","last_became_peered":"2024-09-10T09:22:38.954549+0000","last_unstale":"2024-09-10T09:22:40.765481+0000","last_undegraded":"2024-09-10T09:22:40.765481+0000","last_fullsized":"2024-09-10T09:22:40.765481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:50.063910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956131+0000","last_change":"2024-09-10T09:22:38.952469+0000","last_active":"2024-09-10T09:22:39.956131+0000","last_peered":"2024-09-10T09:22:39.956131+0000","last_clean":"2024-09-10T09:22:39.956131+0000","last_became_active":"2024-09-10T09:22:38.952191+0000","last_became_peered":"2024-09-10T09:22:38.952191+0000","last_unstale":"2024-09-10T09:22:39.956131+0000","last_undegraded":"2024-09-10T09:22:39.956131+0000","last_fullsized":"2024-09-10T09:22:39.956131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:08.191798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959960+0000","last_change":"2024-09-10T09:22:38.959740+0000","last_active":"2024-09-10T09:22:39.959960+0000","last_peered":"2024-09-10T09:22:39.959960+0000","last_clean":"2024-09-10T09:22:39.959960+0000","last_became_active":"2024-09-10T09:22:38.959256+0000","last_became_peered":"2024-09-10T09:22:38.959256+0000","last_unstale":"2024-09-10T09:22:39.959960+0000","last_undegraded":"2024-09-10T09:22:39.959960+0000","last_fullsized":"2024-09-10T09:22:39.959960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:41.583905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960546+0000","last_change":"2024-09-10T09:22:38.964925+0000","last_active":"2024-09-10T09:22:39.960546+0000","last_peered":"2024-09-10T09:22:39.960546+0000","last_clean":"2024-09-10T09:22:39.960546+0000","last_became_active":"2024-09-10T09:22:38.964232+0000","last_became_peered":"2024-09-10T09:22:38.964232+0000","last_unstale":"2024-09-10T09:22:39.960546+0000","last_undegraded":"2024-09-10T09:22:39.960546+0000","last_fullsized":"2024-09-10T09:22:39.960546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:24.977108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765763+0000","last_change":"2024-09-10T09:22:38.975406+0000","last_active":"2024-09-10T09:22:40.765763+0000","last_peered":"2024-09-10T09:22:40.765763+0000","last_clean":"2024-09-10T09:22:40.765763+0000","last_became_active":"2024-09-10T09:22:38.975079+0000","last_became_peered":"2024-09-10T09:22:38.975079+0000","last_unstale":"2024-09-10T09:22:40.765763+0000","last_undegraded":"2024-09-10T09:22:40.765763+0000","last_fullsized":"2024-09-10T09:22:40.765763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:57.060944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394390+0000","last_change":"2024-09-10T09:22:38.964857+0000","last_active":"2024-09-10T09:22:40.394390+0000","last_peered":"2024-09-10T09:22:40.394390+0000","last_clean":"2024-09-10T09:22:40.394390+0000","last_became_active":"2024-09-10T09:22:38.964560+0000","last_became_peered":"2024-09-10T09:22:38.964560+0000","last_unstale":"2024-09-10T09:22:40.394390+0000","last_undegraded":"2024-09-10T09:22:40.394390+0000","last_fullsized":"2024-09-10T09:22:40.394390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:39.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959976+0000","last_change":"2024-09-10T09:22:38.974897+0000","last_active":"2024-09-10T09:22:39.959976+0000","last_peered":"2024-09-10T09:22:39.959976+0000","last_clean":"2024-09-10T09:22:39.959976+0000","last_became_active":"2024-09-10T09:22:38.973651+0000","last_became_peered":"2024-09-10T09:22:38.973651+0000","last_unstale":"2024-09-10T09:22:39.959976+0000","last_undegraded":"2024-09-10T09:22:39.959976+0000","last_fullsized":"2024-09-10T09:22:39.959976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:52.643340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766099+0000","last_change":"2024-09-10T09:22:38.962723+0000","last_active":"2024-09-10T09:22:40.766099+0000","last_peered":"2024-09-10T09:22:40.766099+0000","last_clean":"2024-09-10T09:22:40.766099+0000","last_became_active":"2024-09-10T09:22:38.961742+0000","last_became_peered":"2024-09-10T09:22:38.961742+0000","last_unstale":"2024-09-10T09:22:40.766099+0000","last_undegraded":"2024-09-10T09:22:40.766099+0000","last_fullsized":"2024-09-10T09:22:40.766099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:13.126533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960421+0000","last_change":"2024-09-10T09:22:38.964016+0000","last_active":"2024-09-10T09:22:39.960421+0000","last_peered":"2024-09-10T09:22:39.960421+0000","last_clean":"2024-09-10T09:22:39.960421+0000","last_became_active":"2024-09-10T09:22:38.963653+0000","last_became_peered":"2024-09-10T09:22:38.963653+0000","last_unstale":"2024-09-10T09:22:39.960421+0000","last_undegraded":"2024-09-10T09:22:39.960421+0000","last_fullsized":"2024-09-10T09:22:39.960421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:43.775026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766037+0000","last_change":"2024-09-10T09:22:38.965644+0000","last_active":"2024-09-10T09:22:40.766037+0000","last_peered":"2024-09-10T09:22:40.766037+0000","last_clean":"2024-09-10T09:22:40.766037+0000","last_became_active":"2024-09-10T09:22:38.965355+0000","last_became_peered":"2024-09-10T09:22:38.965355+0000","last_unstale":"2024-09-10T09:22:40.766037+0000","last_undegraded":"2024-09-10T09:22:40.766037+0000","last_fullsized":"2024-09-10T09:22:40.766037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:39.185794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959707+0000","last_change":"2024-09-10T09:22:38.958547+0000","last_active":"2024-09-10T09:22:39.959707+0000","last_peered":"2024-09-10T09:22:39.959707+0000","last_clean":"2024-09-10T09:22:39.959707+0000","last_became_active":"2024-09-10T09:22:38.958063+0000","last_became_peered":"2024-09-10T09:22:38.958063+0000","last_unstale":"2024-09-10T09:22:39.959707+0000","last_undegraded":"2024-09-10T09:22:39.959707+0000","last_fullsized":"2024-09-10T09:22:39.959707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765558+0000","last_change":"2024-09-10T09:22:38.960259+0000","last_active":"2024-09-10T09:22:40.765558+0000","last_peered":"2024-09-10T09:22:40.765558+0000","last_clean":"2024-09-10T09:22:40.765558+0000","last_became_active":"2024-09-10T09:22:38.959749+0000","last_became_peered":"2024-09-10T09:22:38.959749+0000","last_unstale":"2024-09-10T09:22:40.765558+0000","last_undegraded":"2024-09-10T09:22:40.765558+0000","last_fullsized":"2024-09-10T09:22:40.765558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:57.616234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959747+0000","last_change":"2024-09-10T09:22:38.975027+0000","last_active":"2024-09-10T09:22:39.959747+0000","last_peered":"2024-09-10T09:22:39.959747+0000","last_clean":"2024-09-10T09:22:39.959747+0000","last_became_active":"2024-09-10T09:22:38.974540+0000","last_became_peered":"2024-09-10T09:22:38.974540+0000","last_unstale":"2024-09-10T09:22:39.959747+0000","last_undegraded":"2024-09-10T09:22:39.959747+0000","last_fullsized":"2024-09-10T09:22:39.959747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:55.420768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956226+0000","last_change":"2024-09-10T09:22:38.958133+0000","last_active":"2024-09-10T09:22:39.956226+0000","last_peered":"2024-09-10T09:22:39.956226+0000","last_clean":"2024-09-10T09:22:39.956226+0000","last_became_active":"2024-09-10T09:22:38.957783+0000","last_became_peered":"2024-09-10T09:22:38.957783+0000","last_unstale":"2024-09-10T09:22:39.956226+0000","last_undegraded":"2024-09-10T09:22:39.956226+0000","last_fullsized":"2024-09-10T09:22:39.956226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:57.616234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765919+0000","last_change":"2024-09-10T09:22:38.965849+0000","last_active":"2024-09-10T09:22:40.765919+0000","last_peered":"2024-09-10T09:22:40.765919+0000","last_clean":"2024-09-10T09:22:40.765919+0000","last_became_active":"2024-09-10T09:22:38.965247+0000","last_became_peered":"2024-09-10T09:22:38.965247+0000","last_unstale":"2024-09-10T09:22:40.765919+0000","last_undegraded":"2024-09-10T09:22:40.765919+0000","last_fullsized":"2024-09-10T09:22:40.765919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:43.411921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766324+0000","last_change":"2024-09-10T09:22:38.956629+0000","last_active":"2024-09-10T09:22:40.766324+0000","last_peered":"2024-09-10T09:22:40.766324+0000","last_clean":"2024-09-10T09:22:40.766324+0000","last_became_active":"2024-09-10T09:22:38.956335+0000","last_became_peered":"2024-09-10T09:22:38.956335+0000","last_unstale":"2024-09-10T09:22:40.766324+0000","last_undegraded":"2024-09-10T09:22:40.766324+0000","last_fullsized":"2024-09-10T09:22:40.766324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:54.998590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960500+0000","last_change":"2024-09-10T09:22:38.960158+0000","last_active":"2024-09-10T09:22:39.960500+0000","last_peered":"2024-09-10T09:22:39.960500+0000","last_clean":"2024-09-10T09:22:39.960500+0000","last_became_active":"2024-09-10T09:22:38.959580+0000","last_became_peered":"2024-09-10T09:22:38.959580+0000","last_unstale":"2024-09-10T09:22:39.960500+0000","last_undegraded":"2024-09-10T09:22:39.960500+0000","last_fullsized":"2024-09-10T09:22:39.960500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:42.311244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765707+0000","last_change":"2024-09-10T09:22:38.960529+0000","last_active":"2024-09-10T09:22:40.765707+0000","last_peered":"2024-09-10T09:22:40.765707+0000","last_clean":"2024-09-10T09:22:40.765707+0000","last_became_active":"2024-09-10T09:22:38.960209+0000","last_became_peered":"2024-09-10T09:22:38.960209+0000","last_unstale":"2024-09-10T09:22:40.765707+0000","last_undegraded":"2024-09-10T09:22:40.765707+0000","last_fullsized":"2024-09-10T09:22:40.765707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:31.694645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959265+0000","last_change":"2024-09-10T09:22:38.974404+0000","last_active":"2024-09-10T09:22:39.959265+0000","last_peered":"2024-09-10T09:22:39.959265+0000","last_clean":"2024-09-10T09:22:39.959265+0000","last_became_active":"2024-09-10T09:22:38.973533+0000","last_became_peered":"2024-09-10T09:22:38.973533+0000","last_unstale":"2024-09-10T09:22:39.959265+0000","last_undegraded":"2024-09-10T09:22:39.959265+0000","last_fullsized":"2024-09-10T09:22:39.959265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:07.172679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958530+0000","last_change":"2024-09-10T09:22:38.954218+0000","last_active":"2024-09-10T09:22:39.958530+0000","last_peered":"2024-09-10T09:22:39.958530+0000","last_clean":"2024-09-10T09:22:39.958530+0000","last_became_active":"2024-09-10T09:22:38.953944+0000","last_became_peered":"2024-09-10T09:22:38.953944+0000","last_unstale":"2024-09-10T09:22:39.958530+0000","last_undegraded":"2024-09-10T09:22:39.958530+0000","last_fullsized":"2024-09-10T09:22:39.958530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:51.764396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766086+0000","last_change":"2024-09-10T09:22:37.936550+0000","last_active":"2024-09-10T09:22:40.766086+0000","last_peered":"2024-09-10T09:22:40.766086+0000","last_clean":"2024-09-10T09:22:40.766086+0000","last_became_active":"2024-09-10T09:22:37.936210+0000","last_became_peered":"2024-09-10T09:22:37.936210+0000","last_unstale":"2024-09-10T09:22:40.766086+0000","last_undegraded":"2024-09-10T09:22:40.766086+0000","last_fullsized":"2024-09-10T09:22:40.766086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:23.206231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766490+0000","last_change":"2024-09-10T09:22:38.952425+0000","last_active":"2024-09-10T09:22:40.766490+0000","last_peered":"2024-09-10T09:22:40.766490+0000","last_clean":"2024-09-10T09:22:40.766490+0000","last_became_active":"2024-09-10T09:22:38.952127+0000","last_became_peered":"2024-09-10T09:22:38.952127+0000","last_unstale":"2024-09-10T09:22:40.766490+0000","last_undegraded":"2024-09-10T09:22:40.766490+0000","last_fullsized":"2024-09-10T09:22:40.766490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:31.282824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959522+0000","last_change":"2024-09-10T09:22:37.933314+0000","last_active":"2024-09-10T09:22:39.959522+0000","last_peered":"2024-09-10T09:22:39.959522+0000","last_clean":"2024-09-10T09:22:39.959522+0000","last_became_active":"2024-09-10T09:22:37.933023+0000","last_became_peered":"2024-09-10T09:22:37.933023+0000","last_unstale":"2024-09-10T09:22:39.959522+0000","last_undegraded":"2024-09-10T09:22:39.959522+0000","last_fullsized":"2024-09-10T09:22:39.959522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766210+0000","last_change":"2024-09-10T09:22:37.938729+0000","last_active":"2024-09-10T09:22:40.766210+0000","last_peered":"2024-09-10T09:22:40.766210+0000","last_clean":"2024-09-10T09:22:40.766210+0000","last_became_active":"2024-09-10T09:22:37.938423+0000","last_became_peered":"2024-09-10T09:22:37.938423+0000","last_unstale":"2024-09-10T09:22:40.766210+0000","last_undegraded":"2024-09-10T09:22:40.766210+0000","last_fullsized":"2024-09-10T09:22:40.766210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:49.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765295+0000","last_change":"2024-09-10T09:22:38.971494+0000","last_active":"2024-09-10T09:22:40.765295+0000","last_peered":"2024-09-10T09:22:40.765295+0000","last_clean":"2024-09-10T09:22:40.765295+0000","last_became_active":"2024-09-10T09:22:38.971139+0000","last_became_peered":"2024-09-10T09:22:38.971139+0000","last_unstale":"2024-09-10T09:22:40.765295+0000","last_undegraded":"2024-09-10T09:22:40.765295+0000","last_fullsized":"2024-09-10T09:22:40.765295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:19.609624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959768+0000","last_change":"2024-09-10T09:22:37.935606+0000","last_active":"2024-09-10T09:22:39.959768+0000","last_peered":"2024-09-10T09:22:39.959768+0000","last_clean":"2024-09-10T09:22:39.959768+0000","last_became_active":"2024-09-10T09:22:37.935277+0000","last_became_peered":"2024-09-10T09:22:37.935277+0000","last_unstale":"2024-09-10T09:22:39.959768+0000","last_undegraded":"2024-09-10T09:22:39.959768+0000","last_fullsized":"2024-09-10T09:22:39.959768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956122+0000","last_change":"2024-09-10T09:22:38.958931+0000","last_active":"2024-09-10T09:22:39.956122+0000","last_peered":"2024-09-10T09:22:39.956122+0000","last_clean":"2024-09-10T09:22:39.956122+0000","last_became_active":"2024-09-10T09:22:38.958607+0000","last_became_peered":"2024-09-10T09:22:38.958607+0000","last_unstale":"2024-09-10T09:22:39.956122+0000","last_undegraded":"2024-09-10T09:22:39.956122+0000","last_fullsized":"2024-09-10T09:22:39.956122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:19.609624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959625+0000","last_change":"2024-09-10T09:22:37.935791+0000","last_active":"2024-09-10T09:22:39.959625+0000","last_peered":"2024-09-10T09:22:39.959625+0000","last_clean":"2024-09-10T09:22:39.959625+0000","last_became_active":"2024-09-10T09:22:37.935513+0000","last_became_peered":"2024-09-10T09:22:37.935513+0000","last_unstale":"2024-09-10T09:22:39.959625+0000","last_undegraded":"2024-09-10T09:22:39.959625+0000","last_fullsized":"2024-09-10T09:22:39.959625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960442+0000","last_change":"2024-09-10T09:22:38.962591+0000","last_active":"2024-09-10T09:22:39.960442+0000","last_peered":"2024-09-10T09:22:39.960442+0000","last_clean":"2024-09-10T09:22:39.960442+0000","last_became_active":"2024-09-10T09:22:38.962315+0000","last_became_peered":"2024-09-10T09:22:38.962315+0000","last_unstale":"2024-09-10T09:22:39.960442+0000","last_undegraded":"2024-09-10T09:22:39.960442+0000","last_fullsized":"2024-09-10T09:22:39.960442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:52.288196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960253+0000","last_change":"2024-09-10T09:22:37.935382+0000","last_active":"2024-09-10T09:22:39.960253+0000","last_peered":"2024-09-10T09:22:39.960253+0000","last_clean":"2024-09-10T09:22:39.960253+0000","last_became_active":"2024-09-10T09:22:37.935104+0000","last_became_peered":"2024-09-10T09:22:37.935104+0000","last_unstale":"2024-09-10T09:22:39.960253+0000","last_undegraded":"2024-09-10T09:22:39.960253+0000","last_fullsized":"2024-09-10T09:22:39.960253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766147+0000","last_change":"2024-09-10T09:22:38.960788+0000","last_active":"2024-09-10T09:22:40.766147+0000","last_peered":"2024-09-10T09:22:40.766147+0000","last_clean":"2024-09-10T09:22:40.766147+0000","last_became_active":"2024-09-10T09:22:38.960491+0000","last_became_peered":"2024-09-10T09:22:38.960491+0000","last_unstale":"2024-09-10T09:22:40.766147+0000","last_undegraded":"2024-09-10T09:22:40.766147+0000","last_fullsized":"2024-09-10T09:22:40.766147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:55.420768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956170+0000","last_change":"2024-09-10T09:22:37.937277+0000","last_active":"2024-09-10T09:22:39.956170+0000","last_peered":"2024-09-10T09:22:39.956170+0000","last_clean":"2024-09-10T09:22:39.956170+0000","last_became_active":"2024-09-10T09:22:37.936910+0000","last_became_peered":"2024-09-10T09:22:37.936910+0000","last_unstale":"2024-09-10T09:22:39.956170+0000","last_undegraded":"2024-09-10T09:22:39.956170+0000","last_fullsized":"2024-09-10T09:22:39.956170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:32.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958793+0000","last_change":"2024-09-10T09:22:38.962851+0000","last_active":"2024-09-10T09:22:39.958793+0000","last_peered":"2024-09-10T09:22:39.958793+0000","last_clean":"2024-09-10T09:22:39.958793+0000","last_became_active":"2024-09-10T09:22:38.962592+0000","last_became_peered":"2024-09-10T09:22:38.962592+0000","last_unstale":"2024-09-10T09:22:39.958793+0000","last_undegraded":"2024-09-10T09:22:39.958793+0000","last_fullsized":"2024-09-10T09:22:39.958793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:43.844370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960039+0000","last_change":"2024-09-10T09:22:37.940171+0000","last_active":"2024-09-10T09:22:39.960039+0000","last_peered":"2024-09-10T09:22:39.960039+0000","last_clean":"2024-09-10T09:22:39.960039+0000","last_became_active":"2024-09-10T09:22:37.939839+0000","last_became_peered":"2024-09-10T09:22:37.939839+0000","last_unstale":"2024-09-10T09:22:39.960039+0000","last_undegraded":"2024-09-10T09:22:39.960039+0000","last_fullsized":"2024-09-10T09:22:39.960039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394148+0000","last_change":"2024-09-10T09:22:38.966134+0000","last_active":"2024-09-10T09:22:40.394148+0000","last_peered":"2024-09-10T09:22:40.394148+0000","last_clean":"2024-09-10T09:22:40.394148+0000","last_became_active":"2024-09-10T09:22:38.965850+0000","last_became_peered":"2024-09-10T09:22:38.965850+0000","last_unstale":"2024-09-10T09:22:40.394148+0000","last_undegraded":"2024-09-10T09:22:40.394148+0000","last_fullsized":"2024-09-10T09:22:40.394148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:52.288196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766436+0000","last_change":"2024-09-10T09:22:37.934809+0000","last_active":"2024-09-10T09:22:40.766436+0000","last_peered":"2024-09-10T09:22:40.766436+0000","last_clean":"2024-09-10T09:22:40.766436+0000","last_became_active":"2024-09-10T09:22:37.934290+0000","last_became_peered":"2024-09-10T09:22:37.934290+0000","last_unstale":"2024-09-10T09:22:40.766436+0000","last_undegraded":"2024-09-10T09:22:40.766436+0000","last_fullsized":"2024-09-10T09:22:40.766436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:24.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765636+0000","last_change":"2024-09-10T09:22:38.961877+0000","last_active":"2024-09-10T09:22:40.765636+0000","last_peered":"2024-09-10T09:22:40.765636+0000","last_clean":"2024-09-10T09:22:40.765636+0000","last_became_active":"2024-09-10T09:22:38.961552+0000","last_became_peered":"2024-09-10T09:22:38.961552+0000","last_unstale":"2024-09-10T09:22:40.765636+0000","last_undegraded":"2024-09-10T09:22:40.765636+0000","last_fullsized":"2024-09-10T09:22:40.765636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:17.820088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960481+0000","last_change":"2024-09-10T09:22:37.930753+0000","last_active":"2024-09-10T09:22:39.960481+0000","last_peered":"2024-09-10T09:22:39.960481+0000","last_clean":"2024-09-10T09:22:39.960481+0000","last_became_active":"2024-09-10T09:22:37.930430+0000","last_became_peered":"2024-09-10T09:22:37.930430+0000","last_unstale":"2024-09-10T09:22:39.960481+0000","last_undegraded":"2024-09-10T09:22:39.960481+0000","last_fullsized":"2024-09-10T09:22:39.960481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394076+0000","last_change":"2024-09-10T09:22:38.967848+0000","last_active":"2024-09-10T09:22:40.394076+0000","last_peered":"2024-09-10T09:22:40.394076+0000","last_clean":"2024-09-10T09:22:40.394076+0000","last_became_active":"2024-09-10T09:22:38.967573+0000","last_became_peered":"2024-09-10T09:22:38.967573+0000","last_unstale":"2024-09-10T09:22:40.394076+0000","last_undegraded":"2024-09-10T09:22:40.394076+0000","last_fullsized":"2024-09-10T09:22:40.394076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:43.775026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959289+0000","last_change":"2024-09-10T09:22:37.938173+0000","last_active":"2024-09-10T09:22:39.959289+0000","last_peered":"2024-09-10T09:22:39.959289+0000","last_clean":"2024-09-10T09:22:39.959289+0000","last_became_active":"2024-09-10T09:22:37.937876+0000","last_became_peered":"2024-09-10T09:22:37.937876+0000","last_unstale":"2024-09-10T09:22:39.959289+0000","last_undegraded":"2024-09-10T09:22:39.959289+0000","last_fullsized":"2024-09-10T09:22:39.959289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:47.182456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959422+0000","last_change":"2024-09-10T09:22:38.970503+0000","last_active":"2024-09-10T09:22:39.959422+0000","last_peered":"2024-09-10T09:22:39.959422+0000","last_clean":"2024-09-10T09:22:39.959422+0000","last_became_active":"2024-09-10T09:22:38.970224+0000","last_became_peered":"2024-09-10T09:22:38.970224+0000","last_unstale":"2024-09-10T09:22:39.959422+0000","last_undegraded":"2024-09-10T09:22:39.959422+0000","last_fullsized":"2024-09-10T09:22:39.959422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:13.126533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.764935+0000","last_change":"2024-09-10T09:22:37.933753+0000","last_active":"2024-09-10T09:22:40.764935+0000","last_peered":"2024-09-10T09:22:40.764935+0000","last_clean":"2024-09-10T09:22:40.764935+0000","last_became_active":"2024-09-10T09:22:37.933380+0000","last_became_peered":"2024-09-10T09:22:37.933380+0000","last_unstale":"2024-09-10T09:22:40.764935+0000","last_undegraded":"2024-09-10T09:22:40.764935+0000","last_fullsized":"2024-09-10T09:22:40.764935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:27.520559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393904+0000","last_change":"2024-09-10T09:22:38.962249+0000","last_active":"2024-09-10T09:22:40.393904+0000","last_peered":"2024-09-10T09:22:40.393904+0000","last_clean":"2024-09-10T09:22:40.393904+0000","last_became_active":"2024-09-10T09:22:38.961485+0000","last_became_peered":"2024-09-10T09:22:38.961485+0000","last_unstale":"2024-09-10T09:22:40.393904+0000","last_undegraded":"2024-09-10T09:22:40.393904+0000","last_fullsized":"2024-09-10T09:22:40.393904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958733+0000","last_change":"2024-09-10T09:22:37.934159+0000","last_active":"2024-09-10T09:22:39.958733+0000","last_peered":"2024-09-10T09:22:39.958733+0000","last_clean":"2024-09-10T09:22:39.958733+0000","last_became_active":"2024-09-10T09:22:37.933759+0000","last_became_peered":"2024-09-10T09:22:37.933759+0000","last_unstale":"2024-09-10T09:22:39.958733+0000","last_undegraded":"2024-09-10T09:22:39.958733+0000","last_fullsized":"2024-09-10T09:22:39.958733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.720468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394303+0000","last_change":"2024-09-10T09:22:38.961879+0000","last_active":"2024-09-10T09:22:40.394303+0000","last_peered":"2024-09-10T09:22:40.394303+0000","last_clean":"2024-09-10T09:22:40.394303+0000","last_became_active":"2024-09-10T09:22:38.961575+0000","last_became_peered":"2024-09-10T09:22:38.961575+0000","last_unstale":"2024-09-10T09:22:40.394303+0000","last_undegraded":"2024-09-10T09:22:40.394303+0000","last_fullsized":"2024-09-10T09:22:40.394303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:32.085819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765573+0000","last_change":"2024-09-10T09:22:37.933460+0000","last_active":"2024-09-10T09:22:40.765573+0000","last_peered":"2024-09-10T09:22:40.765573+0000","last_clean":"2024-09-10T09:22:40.765573+0000","last_became_active":"2024-09-10T09:22:37.933122+0000","last_became_peered":"2024-09-10T09:22:37.933122+0000","last_unstale":"2024-09-10T09:22:40.765573+0000","last_undegraded":"2024-09-10T09:22:40.765573+0000","last_fullsized":"2024-09-10T09:22:40.765573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394516+0000","last_change":"2024-09-10T09:22:38.962830+0000","last_active":"2024-09-10T09:22:40.394516+0000","last_peered":"2024-09-10T09:22:40.394516+0000","last_clean":"2024-09-10T09:22:40.394516+0000","last_became_active":"2024-09-10T09:22:38.962492+0000","last_became_peered":"2024-09-10T09:22:38.962492+0000","last_unstale":"2024-09-10T09:22:40.394516+0000","last_undegraded":"2024-09-10T09:22:40.394516+0000","last_fullsized":"2024-09-10T09:22:40.394516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:49.985776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956292+0000","last_change":"2024-09-10T09:22:37.933280+0000","last_active":"2024-09-10T09:22:39.956292+0000","last_peered":"2024-09-10T09:22:39.956292+0000","last_clean":"2024-09-10T09:22:39.956292+0000","last_became_active":"2024-09-10T09:22:37.933030+0000","last_became_peered":"2024-09-10T09:22:37.933030+0000","last_unstale":"2024-09-10T09:22:39.956292+0000","last_undegraded":"2024-09-10T09:22:39.956292+0000","last_fullsized":"2024-09-10T09:22:39.956292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:45.005434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960085+0000","last_change":"2024-09-10T09:22:38.959317+0000","last_active":"2024-09-10T09:22:39.960085+0000","last_peered":"2024-09-10T09:22:39.960085+0000","last_clean":"2024-09-10T09:22:39.960085+0000","last_became_active":"2024-09-10T09:22:38.958283+0000","last_became_peered":"2024-09-10T09:22:38.958283+0000","last_unstale":"2024-09-10T09:22:39.960085+0000","last_undegraded":"2024-09-10T09:22:39.960085+0000","last_fullsized":"2024-09-10T09:22:39.960085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:26.724466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765432+0000","last_change":"2024-09-10T09:22:37.929435+0000","last_active":"2024-09-10T09:22:40.765432+0000","last_peered":"2024-09-10T09:22:40.765432+0000","last_clean":"2024-09-10T09:22:40.765432+0000","last_became_active":"2024-09-10T09:22:37.929161+0000","last_became_peered":"2024-09-10T09:22:37.929161+0000","last_unstale":"2024-09-10T09:22:40.765432+0000","last_undegraded":"2024-09-10T09:22:40.765432+0000","last_fullsized":"2024-09-10T09:22:40.765432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:24.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394200+0000","last_change":"2024-09-10T09:22:38.964246+0000","last_active":"2024-09-10T09:22:40.394200+0000","last_peered":"2024-09-10T09:22:40.394200+0000","last_clean":"2024-09-10T09:22:40.394200+0000","last_became_active":"2024-09-10T09:22:38.964000+0000","last_became_peered":"2024-09-10T09:22:38.964000+0000","last_unstale":"2024-09-10T09:22:40.394200+0000","last_undegraded":"2024-09-10T09:22:40.394200+0000","last_fullsized":"2024-09-10T09:22:40.394200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:42.311244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393715+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:22:40.393715+0000","last_peered":"2024-09-10T09:22:40.393715+0000","last_clean":"2024-09-10T09:22:40.393715+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:22:40.393715+0000","last_undegraded":"2024-09-10T09:22:40.393715+0000","last_fullsized":"2024-09-10T09:22:40.393715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959675+0000","last_change":"2024-09-10T09:22:37.924543+0000","last_active":"2024-09-10T09:22:39.959675+0000","last_peered":"2024-09-10T09:22:39.959675+0000","last_clean":"2024-09-10T09:22:39.959675+0000","last_became_active":"2024-09-10T09:22:37.924170+0000","last_became_peered":"2024-09-10T09:22:37.924170+0000","last_unstale":"2024-09-10T09:22:39.959675+0000","last_undegraded":"2024-09-10T09:22:39.959675+0000","last_fullsized":"2024-09-10T09:22:39.959675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766370+0000","last_change":"2024-09-10T09:22:38.962024+0000","last_active":"2024-09-10T09:22:40.766370+0000","last_peered":"2024-09-10T09:22:40.766370+0000","last_clean":"2024-09-10T09:22:40.766370+0000","last_became_active":"2024-09-10T09:22:38.961394+0000","last_became_peered":"2024-09-10T09:22:38.961394+0000","last_unstale":"2024-09-10T09:22:40.766370+0000","last_undegraded":"2024-09-10T09:22:40.766370+0000","last_fullsized":"2024-09-10T09:22:40.766370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:25.333541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393609+0000","last_change":"2024-09-10T09:22:37.937745+0000","last_active":"2024-09-10T09:22:40.393609+0000","last_peered":"2024-09-10T09:22:40.393609+0000","last_clean":"2024-09-10T09:22:40.393609+0000","last_became_active":"2024-09-10T09:22:37.937135+0000","last_became_peered":"2024-09-10T09:22:37.937135+0000","last_unstale":"2024-09-10T09:22:40.393609+0000","last_undegraded":"2024-09-10T09:22:40.393609+0000","last_fullsized":"2024-09-10T09:22:40.393609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.764993+0000","last_change":"2024-09-10T09:22:38.950945+0000","last_active":"2024-09-10T09:22:40.764993+0000","last_peered":"2024-09-10T09:22:40.764993+0000","last_clean":"2024-09-10T09:22:40.764993+0000","last_became_active":"2024-09-10T09:22:38.950620+0000","last_became_peered":"2024-09-10T09:22:38.950620+0000","last_unstale":"2024-09-10T09:22:40.764993+0000","last_undegraded":"2024-09-10T09:22:40.764993+0000","last_fullsized":"2024-09-10T09:22:40.764993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.669603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765326+0000","last_change":"2024-09-10T09:22:37.932613+0000","last_active":"2024-09-10T09:22:40.765326+0000","last_peered":"2024-09-10T09:22:40.765326+0000","last_clean":"2024-09-10T09:22:40.765326+0000","last_became_active":"2024-09-10T09:22:37.932294+0000","last_became_peered":"2024-09-10T09:22:37.932294+0000","last_unstale":"2024-09-10T09:22:40.765326+0000","last_undegraded":"2024-09-10T09:22:40.765326+0000","last_fullsized":"2024-09-10T09:22:40.765326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:47.182456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956126+0000","last_change":"2024-09-10T09:22:38.953678+0000","last_active":"2024-09-10T09:22:39.956126+0000","last_peered":"2024-09-10T09:22:39.956126+0000","last_clean":"2024-09-10T09:22:39.956126+0000","last_became_active":"2024-09-10T09:22:38.953377+0000","last_became_peered":"2024-09-10T09:22:38.953377+0000","last_unstale":"2024-09-10T09:22:39.956126+0000","last_undegraded":"2024-09-10T09:22:39.956126+0000","last_fullsized":"2024-09-10T09:22:39.956126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:38.287488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960562+0000","last_change":"2024-09-10T09:22:37.933538+0000","last_active":"2024-09-10T09:22:39.960562+0000","last_peered":"2024-09-10T09:22:39.960562+0000","last_clean":"2024-09-10T09:22:39.960562+0000","last_became_active":"2024-09-10T09:22:37.933239+0000","last_became_peered":"2024-09-10T09:22:37.933239+0000","last_unstale":"2024-09-10T09:22:39.960562+0000","last_undegraded":"2024-09-10T09:22:39.960562+0000","last_fullsized":"2024-09-10T09:22:39.960562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:59.238916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958827+0000","last_change":"2024-09-10T09:22:38.958116+0000","last_active":"2024-09-10T09:22:39.958827+0000","last_peered":"2024-09-10T09:22:39.958827+0000","last_clean":"2024-09-10T09:22:39.958827+0000","last_became_active":"2024-09-10T09:22:38.957831+0000","last_became_peered":"2024-09-10T09:22:38.957831+0000","last_unstale":"2024-09-10T09:22:39.958827+0000","last_undegraded":"2024-09-10T09:22:39.958827+0000","last_fullsized":"2024-09-10T09:22:39.958827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:26.169482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956283+0000","last_change":"2024-09-10T09:22:37.931279+0000","last_active":"2024-09-10T09:22:39.956283+0000","last_peered":"2024-09-10T09:22:39.956283+0000","last_clean":"2024-09-10T09:22:39.956283+0000","last_became_active":"2024-09-10T09:22:37.930991+0000","last_became_peered":"2024-09-10T09:22:37.930991+0000","last_unstale":"2024-09-10T09:22:39.956283+0000","last_undegraded":"2024-09-10T09:22:39.956283+0000","last_fullsized":"2024-09-10T09:22:39.956283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:25.167130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960530+0000","last_change":"2024-09-10T09:22:38.962689+0000","last_active":"2024-09-10T09:22:39.960530+0000","last_peered":"2024-09-10T09:22:39.960530+0000","last_clean":"2024-09-10T09:22:39.960530+0000","last_became_active":"2024-09-10T09:22:38.962301+0000","last_became_peered":"2024-09-10T09:22:38.962301+0000","last_unstale":"2024-09-10T09:22:39.960530+0000","last_undegraded":"2024-09-10T09:22:39.960530+0000","last_fullsized":"2024-09-10T09:22:39.960530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:39.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394321+0000","last_change":"2024-09-10T09:22:37.936685+0000","last_active":"2024-09-10T09:22:40.394321+0000","last_peered":"2024-09-10T09:22:40.394321+0000","last_clean":"2024-09-10T09:22:40.394321+0000","last_became_active":"2024-09-10T09:22:37.936351+0000","last_became_peered":"2024-09-10T09:22:37.936351+0000","last_unstale":"2024-09-10T09:22:40.394321+0000","last_undegraded":"2024-09-10T09:22:40.394321+0000","last_fullsized":"2024-09-10T09:22:40.394321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:45.574031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956260+0000","last_change":"2024-09-10T09:22:38.953660+0000","last_active":"2024-09-10T09:22:39.956260+0000","last_peered":"2024-09-10T09:22:39.956260+0000","last_clean":"2024-09-10T09:22:39.956260+0000","last_became_active":"2024-09-10T09:22:38.953385+0000","last_became_peered":"2024-09-10T09:22:38.953385+0000","last_unstale":"2024-09-10T09:22:39.956260+0000","last_undegraded":"2024-09-10T09:22:39.956260+0000","last_fullsized":"2024-09-10T09:22:39.956260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:39.464012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956275+0000","last_change":"2024-09-10T09:22:37.935773+0000","last_active":"2024-09-10T09:22:39.956275+0000","last_peered":"2024-09-10T09:22:39.956275+0000","last_clean":"2024-09-10T09:22:39.956275+0000","last_became_active":"2024-09-10T09:22:37.934987+0000","last_became_peered":"2024-09-10T09:22:37.934987+0000","last_unstale":"2024-09-10T09:22:39.956275+0000","last_undegraded":"2024-09-10T09:22:39.956275+0000","last_fullsized":"2024-09-10T09:22:39.956275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:50.762044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765703+0000","last_change":"2024-09-10T09:22:38.967459+0000","last_active":"2024-09-10T09:22:40.765703+0000","last_peered":"2024-09-10T09:22:40.765703+0000","last_clean":"2024-09-10T09:22:40.765703+0000","last_became_active":"2024-09-10T09:22:38.967196+0000","last_became_peered":"2024-09-10T09:22:38.967196+0000","last_unstale":"2024-09-10T09:22:40.765703+0000","last_undegraded":"2024-09-10T09:22:40.765703+0000","last_fullsized":"2024-09-10T09:22:40.765703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:39.464012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959741+0000","last_change":"2024-09-10T09:22:37.933918+0000","last_active":"2024-09-10T09:22:39.959741+0000","last_peered":"2024-09-10T09:22:39.959741+0000","last_clean":"2024-09-10T09:22:39.959741+0000","last_became_active":"2024-09-10T09:22:37.933296+0000","last_became_peered":"2024-09-10T09:22:37.933296+0000","last_unstale":"2024-09-10T09:22:39.959741+0000","last_undegraded":"2024-09-10T09:22:39.959741+0000","last_fullsized":"2024-09-10T09:22:39.959741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766192+0000","last_change":"2024-09-10T09:22:38.955166+0000","last_active":"2024-09-10T09:22:40.766192+0000","last_peered":"2024-09-10T09:22:40.766192+0000","last_clean":"2024-09-10T09:22:40.766192+0000","last_became_active":"2024-09-10T09:22:38.954427+0000","last_became_peered":"2024-09-10T09:22:38.954427+0000","last_unstale":"2024-09-10T09:22:40.766192+0000","last_undegraded":"2024-09-10T09:22:40.766192+0000","last_fullsized":"2024-09-10T09:22:40.766192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:06.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393603+0000","last_change":"2024-09-10T09:22:37.937409+0000","last_active":"2024-09-10T09:22:40.393603+0000","last_peered":"2024-09-10T09:22:40.393603+0000","last_clean":"2024-09-10T09:22:40.393603+0000","last_became_active":"2024-09-10T09:22:37.937072+0000","last_became_peered":"2024-09-10T09:22:37.937072+0000","last_unstale":"2024-09-10T09:22:40.393603+0000","last_undegraded":"2024-09-10T09:22:40.393603+0000","last_fullsized":"2024-09-10T09:22:40.393603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:36.345396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.958268+0000","last_change":"2024-09-10T09:22:38.953130+0000","last_active":"2024-09-10T09:22:39.958268+0000","last_peered":"2024-09-10T09:22:39.958268+0000","last_clean":"2024-09-10T09:22:39.958268+0000","last_became_active":"2024-09-10T09:22:38.952716+0000","last_became_peered":"2024-09-10T09:22:38.952716+0000","last_unstale":"2024-09-10T09:22:39.958268+0000","last_undegraded":"2024-09-10T09:22:39.958268+0000","last_fullsized":"2024-09-10T09:22:39.958268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:46.007786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956251+0000","last_change":"2024-09-10T09:22:37.936227+0000","last_active":"2024-09-10T09:22:39.956251+0000","last_peered":"2024-09-10T09:22:39.956251+0000","last_clean":"2024-09-10T09:22:39.956251+0000","last_became_active":"2024-09-10T09:22:37.935936+0000","last_became_peered":"2024-09-10T09:22:37.935936+0000","last_unstale":"2024-09-10T09:22:39.956251+0000","last_undegraded":"2024-09-10T09:22:39.956251+0000","last_fullsized":"2024-09-10T09:22:39.956251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:08.115626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765478+0000","last_change":"2024-09-10T09:22:38.956190+0000","last_active":"2024-09-10T09:22:40.765478+0000","last_peered":"2024-09-10T09:22:40.765478+0000","last_clean":"2024-09-10T09:22:40.765478+0000","last_became_active":"2024-09-10T09:22:38.955905+0000","last_became_peered":"2024-09-10T09:22:38.955905+0000","last_unstale":"2024-09-10T09:22:40.765478+0000","last_undegraded":"2024-09-10T09:22:40.765478+0000","last_fullsized":"2024-09-10T09:22:40.765478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:08.191798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.956124+0000","last_change":"2024-09-10T09:22:37.932705+0000","last_active":"2024-09-10T09:22:39.956124+0000","last_peered":"2024-09-10T09:22:39.956124+0000","last_clean":"2024-09-10T09:22:39.956124+0000","last_became_active":"2024-09-10T09:22:37.932417+0000","last_became_peered":"2024-09-10T09:22:37.932417+0000","last_unstale":"2024-09-10T09:22:39.956124+0000","last_undegraded":"2024-09-10T09:22:39.956124+0000","last_fullsized":"2024-09-10T09:22:39.956124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:42.842018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766025+0000","last_change":"2024-09-10T09:22:38.971397+0000","last_active":"2024-09-10T09:22:40.766025+0000","last_peered":"2024-09-10T09:22:40.766025+0000","last_clean":"2024-09-10T09:22:40.766025+0000","last_became_active":"2024-09-10T09:22:38.971061+0000","last_became_peered":"2024-09-10T09:22:38.971061+0000","last_unstale":"2024-09-10T09:22:40.766025+0000","last_undegraded":"2024-09-10T09:22:40.766025+0000","last_fullsized":"2024-09-10T09:22:40.766025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:15.366046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394084+0000","last_change":"2024-09-10T09:22:37.935050+0000","last_active":"2024-09-10T09:22:40.394084+0000","last_peered":"2024-09-10T09:22:40.394084+0000","last_clean":"2024-09-10T09:22:40.394084+0000","last_became_active":"2024-09-10T09:22:37.934776+0000","last_became_peered":"2024-09-10T09:22:37.934776+0000","last_unstale":"2024-09-10T09:22:40.394084+0000","last_undegraded":"2024-09-10T09:22:40.394084+0000","last_fullsized":"2024-09-10T09:22:40.394084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:56.058592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.959848+0000","last_change":"2024-09-10T09:22:38.972540+0000","last_active":"2024-09-10T09:22:39.959848+0000","last_peered":"2024-09-10T09:22:39.959848+0000","last_clean":"2024-09-10T09:22:39.959848+0000","last_became_active":"2024-09-10T09:22:38.972250+0000","last_became_peered":"2024-09-10T09:22:38.972250+0000","last_unstale":"2024-09-10T09:22:39.959848+0000","last_undegraded":"2024-09-10T09:22:39.959848+0000","last_fullsized":"2024-09-10T09:22:39.959848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:06.959189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960526+0000","last_change":"2024-09-10T09:22:38.969444+0000","last_active":"2024-09-10T09:22:39.960526+0000","last_peered":"2024-09-10T09:22:39.960526+0000","last_clean":"2024-09-10T09:22:39.960526+0000","last_became_active":"2024-09-10T09:22:38.968894+0000","last_became_peered":"2024-09-10T09:22:38.968894+0000","last_unstale":"2024-09-10T09:22:39.960526+0000","last_undegraded":"2024-09-10T09:22:39.960526+0000","last_fullsized":"2024-09-10T09:22:39.960526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:32.085819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.393977+0000","last_change":"2024-09-10T09:22:37.935751+0000","last_active":"2024-09-10T09:22:40.393977+0000","last_peered":"2024-09-10T09:22:40.393977+0000","last_clean":"2024-09-10T09:22:40.393977+0000","last_became_active":"2024-09-10T09:22:37.935466+0000","last_became_peered":"2024-09-10T09:22:37.935466+0000","last_unstale":"2024-09-10T09:22:40.393977+0000","last_undegraded":"2024-09-10T09:22:40.393977+0000","last_fullsized":"2024-09-10T09:22:40.393977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:24.778094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:39.960197+0000","last_change":"2024-09-10T09:22:38.969161+0000","last_active":"2024-09-10T09:22:39.960197+0000","last_peered":"2024-09-10T09:22:39.960197+0000","last_clean":"2024-09-10T09:22:39.960197+0000","last_became_active":"2024-09-10T09:22:38.968833+0000","last_became_peered":"2024-09-10T09:22:38.968833+0000","last_unstale":"2024-09-10T09:22:39.960197+0000","last_undegraded":"2024-09-10T09:22:39.960197+0000","last_fullsized":"2024-09-10T09:22:39.960197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:08.149787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.394206+0000","last_change":"2024-09-10T09:22:37.938067+0000","last_active":"2024-09-10T09:22:40.394206+0000","last_peered":"2024-09-10T09:22:40.394206+0000","last_clean":"2024-09-10T09:22:40.394206+0000","last_became_active":"2024-09-10T09:22:37.937760+0000","last_became_peered":"2024-09-10T09:22:37.937760+0000","last_unstale":"2024-09-10T09:22:40.394206+0000","last_undegraded":"2024-09-10T09:22:40.394206+0000","last_fullsized":"2024-09-10T09:22:40.394206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:09.281127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765966+0000","last_change":"2024-09-10T09:22:38.960874+0000","last_active":"2024-09-10T09:22:40.765966+0000","last_peered":"2024-09-10T09:22:40.765966+0000","last_clean":"2024-09-10T09:22:40.765966+0000","last_became_active":"2024-09-10T09:22:38.960543+0000","last_became_peered":"2024-09-10T09:22:38.960543+0000","last_unstale":"2024-09-10T09:22:40.765966+0000","last_undegraded":"2024-09-10T09:22:40.765966+0000","last_fullsized":"2024-09-10T09:22:40.765966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:07.172679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765791+0000","last_change":"2024-09-10T09:22:37.937400+0000","last_active":"2024-09-10T09:22:40.765791+0000","last_peered":"2024-09-10T09:22:40.765791+0000","last_clean":"2024-09-10T09:22:40.765791+0000","last_became_active":"2024-09-10T09:22:37.934936+0000","last_became_peered":"2024-09-10T09:22:37.934936+0000","last_unstale":"2024-09-10T09:22:40.765791+0000","last_undegraded":"2024-09-10T09:22:40.765791+0000","last_fullsized":"2024-09-10T09:22:40.765791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:14.717544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.765375+0000","last_change":"2024-09-10T09:22:38.975581+0000","last_active":"2024-09-10T09:22:40.765375+0000","last_peered":"2024-09-10T09:22:40.765375+0000","last_clean":"2024-09-10T09:22:40.765375+0000","last_became_active":"2024-09-10T09:22:38.975251+0000","last_became_peered":"2024-09-10T09:22:38.975251+0000","last_unstale":"2024-09-10T09:22:40.765375+0000","last_undegraded":"2024-09-10T09:22:40.765375+0000","last_fullsized":"2024-09-10T09:22:40.765375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:37.913422+0000","last_clean_scrub_stamp":"2024-09-10T09:22:37.913422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:38.287488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T09:22:40.766352+0000","last_change":"2024-09-10T09:22:37.933756+0000","last_active":"2024-09-10T09:22:40.766352+0000","last_peered":"2024-09-10T09:22:40.766352+0000","last_clean":"2024-09-10T09:22:40.766352+0000","last_became_active":"2024-09-10T09:22:37.933486+0000","last_became_peered":"2024-09-10T09:22:37.933486+0000","last_unstale":"2024-09-10T09:22:40.766352+0000","last_undegraded":"2024-09-10T09:22:40.766352+0000","last_fullsized":"2024-09-10T09:22:40.766352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:36.911070+0000","last_clean_scrub_stamp":"2024-09-10T09:22:36.911070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:19.576934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":665039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":74179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":74089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":819200,"data_stored":665095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:22:47.695 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T09:22:47.695 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T09:22:47.695 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T09:22:47.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T09:22:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.807+0000 7f0b5199f640 1 Processor -- start 2024-09-10T09:22:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.807+0000 7f0b5199f640 1 -- start start 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5199f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c0d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5199f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0b4c0b32e0 0x7f0b4c0b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5199f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0cfb00 con 0x7f0b4c0b3830 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5199f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4c06cf60 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5199f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c0d1d60 con 0x7f0b4c0d1440 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5119e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0b4c0b32e0 0x7f0b4c0b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5119e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0b4c0b32e0 0x7f0b4c0b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46118/0 (socket says 172.21.15.12:46118) 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5119e640 1 -- 172.21.15.12:0/709421508 learned_addr learned my addr 172.21.15.12:0/709421508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.808+0000 7f0b5099d640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c0d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b5119e640 1 -- 172.21.15.12:0/709421508 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 msgr2=0x7f0b4c0d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b5119e640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c0d1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b5119e640 1 -- 172.21.15.12:0/709421508 >> v1:172.21.15.100:6789/0 conn(0x7f0b4c0b3830 legacy=0x7f0b4c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b5119e640 1 -- 172.21.15.12:0/709421508 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0d3a30 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b5099d640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c0d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b5119e640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0b74d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009e50 tx=0x7f0b4402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab675d62f0ad64a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.809+0000 7f0b4b7fe640 1 -- 172.21.15.12:0/709421508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44036070 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b4b7fe640 1 -- 172.21.15.12:0/709421508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b44031600 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b4b7fe640 1 -- 172.21.15.12:0/709421508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440319d0 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 -- 172.21.15.12:0/709421508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 msgr2=0x7f0b4c0b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0b74d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009e50 tx=0x7f0b4402a630 comp rx=0 tx=0).stop 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 -- 172.21.15.12:0/709421508 shutdown_connections 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0b74d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 --2- 172.21.15.12:0/709421508 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c0d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 -- 172.21.15.12:0/709421508 >> 172.21.15.12:0/709421508 conn(0x7f0b4c0b6400 msgr2=0x7f0b4c0b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 -- 172.21.15.12:0/709421508 shutdown_connections 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.810+0000 7f0b5199f640 1 -- 172.21.15.12:0/709421508 wait complete. 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.811+0000 7f0b5199f640 1 Processor -- start 2024-09-10T09:22:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.811+0000 7f0b5199f640 1 -- start start 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5199f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5199f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0b3830 0x7f0b4c0aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5199f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c1f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5199f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c06c070 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5199f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0d3ff0 con 0x7f0b4c0b3830 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5199f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c06c350 con 0x7f0b4c0d1440 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5099d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5099d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46120/0 (socket says 172.21.15.12:46120) 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5099d640 1 -- 172.21.15.12:0/2891371416 learned_addr learned my addr 172.21.15.12:0/2891371416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b4bfff640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0b3830 0x7f0b4c0aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.812+0000 7f0b5119e640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c1f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5099d640 1 -- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 msgr2=0x7f0b4c1f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5099d640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c1f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5099d640 1 -- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0b3830 msgr2=0x7f0b4c0aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5099d640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0b3830 0x7f0b4c0aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5099d640 1 -- 172.21.15.12:0/2891371416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0ab720 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5099d640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0ca6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00c7f0 tx=0x7f0b3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c015070 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b3c007820 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c0aba00 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c007bd0 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.813+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c0abfc0 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.814+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c0b7e30 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.814+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b3c018070 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.815+0000 7f0b497fa640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.815+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b3c08ae90 con 0x7f0b4c0b32e0 2024-09-10T09:22:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.815+0000 7f0b4bfff640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.816+0000 7f0b4bfff640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0d2cc0 tx=0x7f0b34007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:47.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:47.819+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b4c0b7e30 con 0x7f0b4c0b32e0 2024-09-10T09:22:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.032+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b4c15eb40 con 0x7f0b4c0b32e0 2024-09-10T09:22:48.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.032+0000 7f0b497fa640 1 -- 172.21.15.12:0/2891371416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0b3c059280 con 0x7f0b4c0b32e0 2024-09-10T09:22:48.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:48.033 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T09:22:48.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0b2c06be30 msgr2=0x7f0b2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0d2cc0 tx=0x7f0b34007e30 comp rx=0 tx=0).stop 2024-09-10T09:22:48.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 msgr2=0x7f0b4c0ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0ca6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00c7f0 tx=0x7f0b3c00ccb0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 shutdown_connections 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0b2c06be30 0x7f0b2c06e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0b4c0d1440 0x7f0b4c1f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b4c0b3830 0x7f0b4c0aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 --2- 172.21.15.12:0/2891371416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b4c0b32e0 0x7f0b4c0ca6f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 >> 172.21.15.12:0/2891371416 conn(0x7f0b4c0b6400 msgr2=0x7f0b4c0b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 shutdown_connections 2024-09-10T09:22:48.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.034+0000 7f0b5199f640 1 -- 172.21.15.12:0/2891371416 wait complete. 2024-09-10T09:22:48.046 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T09:22:48.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:22:48.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.190+0000 7f0434ad7640 1 Processor -- start 2024-09-10T09:22:48.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.190+0000 7f0434ad7640 1 -- start start 2024-09-10T09:22:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f0434ad7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f043015e940 0x7f04300d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f0434ad7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f043015ed20 0x7f04300d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f0434ad7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04300b7170 con 0x7f04300cef90 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f0434ad7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f04300d1ae0 con 0x7f043015e940 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f0434ad7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f04300b7aa0 con 0x7f043015ed20 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f042e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f043015e940 0x7f04300d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f042ed9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f04300cef90 0x7f04300b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51728/0 (socket says 172.21.15.12:51728) 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.191+0000 7f042ed9d640 1 -- 172.21.15.12:0/3356250672 learned_addr learned my addr 172.21.15.12:0/3356250672 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.192+0000 7f0427fff640 1 --2- 172.21.15.12:0/3356250672 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f043015ed20 0x7f04300d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.192+0000 7f042e59c640 1 -- 172.21.15.12:0/3356250672 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f043015ed20 msgr2=0x7f04300d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.192+0000 7f042e59c640 1 --2- 172.21.15.12:0/3356250672 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f043015ed20 0x7f04300d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.192+0000 7f042e59c640 1 -- 172.21.15.12:0/3356250672 >> v1:172.21.15.12:6789/0 conn(0x7f04300cef90 legacy=0x7f04300b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.192+0000 7f042e59c640 1 -- 172.21.15.12:0/3356250672 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04300d3660 con 0x7f043015e940 2024-09-10T09:22:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.192+0000 7f042e59c640 1 --2- 172.21.15.12:0/3356250672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015e940 0x7f04300d1060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04200097a0 tx=0x7f042002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c904177133e374 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f042dd9b640 1 -- 172.21.15.12:0/3356250672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420037070 con 0x7f043015e940 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f042dd9b640 1 -- 172.21.15.12:0/3356250672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0420032440 con 0x7f043015e940 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f042dd9b640 1 -- 172.21.15.12:0/3356250672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420032810 con 0x7f043015e940 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 -- 172.21.15.12:0/3356250672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015e940 msgr2=0x7f04300d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 --2- 172.21.15.12:0/3356250672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015e940 0x7f04300d1060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f04200097a0 tx=0x7f042002a210 comp rx=0 tx=0).stop 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 -- 172.21.15.12:0/3356250672 shutdown_connections 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 --2- 172.21.15.12:0/3356250672 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f043015ed20 0x7f04300d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 --2- 172.21.15.12:0/3356250672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015e940 0x7f04300d1060 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 -- 172.21.15.12:0/3356250672 >> 172.21.15.12:0/3356250672 conn(0x7f04300b6240 msgr2=0x7f04300b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 -- 172.21.15.12:0/3356250672 shutdown_connections 2024-09-10T09:22:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.193+0000 7f0434ad7640 1 -- 172.21.15.12:0/3356250672 wait complete. 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 Processor -- start 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 -- start start 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f04300cef90 0x7f04301f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f043015e940 0x7f0430157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 0x7f043015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f04300d3f00 con 0x7f043015ed20 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04300d3c20 con 0x7f043015e940 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f0434ad7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f04300d3310 con 0x7f04300cef90 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f042ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 0x7f043015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f042ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 0x7f043015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46128/0 (socket says 172.21.15.12:46128) 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.195+0000 7f042ed9d640 1 -- 172.21.15.12:0/2416853617 learned_addr learned my addr 172.21.15.12:0/2416853617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042e59c640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f04300cef90 0x7f04301f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f0427fff640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f043015e940 0x7f0430157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042ed9d640 1 -- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f04300cef90 msgr2=0x7f04301f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042ed9d640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f04300cef90 0x7f04301f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042ed9d640 1 -- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f043015e940 msgr2=0x7f0430157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042ed9d640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f043015e940 0x7f0430157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042ed9d640 1 -- 172.21.15.12:0/2416853617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04301f6680 con 0x7f043015ed20 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f042ed9d640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 0x7f043015bd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f042800ca80 tx=0x7f042800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428017070 con 0x7f043015ed20 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042800ac30 con 0x7f043015ed20 2024-09-10T09:22:48.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04301f6960 con 0x7f043015ed20 2024-09-10T09:22:48.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428012600 con 0x7f043015ed20 2024-09-10T09:22:48.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.196+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04301f6f20 con 0x7f043015ed20 2024-09-10T09:22:48.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.197+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04300d1f80 con 0x7f043015ed20 2024-09-10T09:22:48.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.198+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f042801a070 con 0x7f043015ed20 2024-09-10T09:22:48.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.198+0000 7f0426ffd640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f041006be30 0x7f041006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.198+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f042808aa20 con 0x7f043015ed20 2024-09-10T09:22:48.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.198+0000 7f042e59c640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f041006be30 0x7f041006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.199+0000 7f042e59c640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f041006be30 0x7f041006e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0420034000 tx=0x7f042002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.203+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04300b7170 con 0x7f043015ed20 2024-09-10T09:22:48.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.414+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04300ba6b0 con 0x7f043015ed20 2024-09-10T09:22:48.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.415+0000 7f0426ffd640 1 -- 172.21.15.12:0/2416853617 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f042800ae20 con 0x7f043015ed20 2024-09-10T09:22:48.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:48.416 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:22:48.416 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f041006be30 msgr2=0x7f041006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f041006be30 0x7f041006e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0420034000 tx=0x7f042002e000 comp rx=0 tx=0).stop 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 msgr2=0x7f043015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 0x7f043015bd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f042800ca80 tx=0x7f042800cf40 comp rx=0 tx=0).stop 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 shutdown_connections 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f041006be30 0x7f041006e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f043015ed20 0x7f043015bd80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f043015e940 0x7f0430157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 --2- 172.21.15.12:0/2416853617 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f04300cef90 0x7f04301f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 >> 172.21.15.12:0/2416853617 conn(0x7f04300b6240 msgr2=0x7f04300b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 shutdown_connections 2024-09-10T09:22:48.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.417+0000 7f0434ad7640 1 -- 172.21.15.12:0/2416853617 wait complete. 2024-09-10T09:22:48.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:22:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.530+0000 7f84832af640 1 Processor -- start 2024-09-10T09:22:48.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.531+0000 7f84832af640 1 -- start start 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.531+0000 7f84832af640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f847c15e940 0x7f847c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.531+0000 7f84832af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15ed20 0x7f847c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.531+0000 7f84832af640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f847c0b7170 con 0x7f847c0cef90 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.531+0000 7f84832af640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f847c0d1ae0 con 0x7f847c15e940 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.531+0000 7f84832af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f847c0b7aa0 con 0x7f847c15ed20 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848184c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f847c0cef90 0x7f847c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51736/0 (socket says 172.21.15.12:51736) 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848184c640 1 -- 172.21.15.12:0/3160965576 learned_addr learned my addr 172.21.15.12:0/3160965576 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848104b640 1 --2- 172.21.15.12:0/3160965576 >> v2:172.21.15.100:3300/0 conn(0x7f847c15e940 0x7f847c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848084a640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15ed20 0x7f847c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f847bfff640 1 -- 172.21.15.12:0/3160965576 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947106921 0 0) 0x7f846c001490 con 0x7f847c0cef90 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f847bfff640 1 -- 172.21.15.12:0/3160965576 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8464003520 con 0x7f847c0cef90 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848104b640 1 -- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15ed20 msgr2=0x7f847c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848104b640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15ed20 0x7f847c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848104b640 1 -- 172.21.15.12:0/3160965576 >> v1:172.21.15.12:6789/0 conn(0x7f847c0cef90 legacy=0x7f847c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848104b640 1 -- 172.21.15.12:0/3160965576 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c0d3660 con 0x7f847c15e940 2024-09-10T09:22:48.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.532+0000 7f848084a640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15ed20 0x7f847c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:48.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.533+0000 7f848104b640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c15e940 0x7f847c0d1060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84740097a0 tx=0x7f847402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5edca1ee52a500c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.533+0000 7f847bfff640 1 -- 172.21.15.12:0/3160965576 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474037070 con 0x7f847c15e940 2024-09-10T09:22:48.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.533+0000 7f847bfff640 1 -- 172.21.15.12:0/3160965576 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8474032440 con 0x7f847c15e940 2024-09-10T09:22:48.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.533+0000 7f847bfff640 1 -- 172.21.15.12:0/3160965576 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84740327f0 con 0x7f847c15e940 2024-09-10T09:22:48.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.533+0000 7f84832af640 1 -- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c15e940 msgr2=0x7f847c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.533+0000 7f84832af640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c15e940 0x7f847c0d1060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84740097a0 tx=0x7f847402a210 comp rx=0 tx=0).stop 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.534+0000 7f84832af640 1 -- 172.21.15.12:0/3160965576 shutdown_connections 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.534+0000 7f84832af640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15ed20 0x7f847c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.534+0000 7f84832af640 1 --2- 172.21.15.12:0/3160965576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c15e940 0x7f847c0d1060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.534+0000 7f84832af640 1 -- 172.21.15.12:0/3160965576 >> 172.21.15.12:0/3160965576 conn(0x7f847c0b6240 msgr2=0x7f847c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.534+0000 7f84832af640 1 -- 172.21.15.12:0/3160965576 shutdown_connections 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.534+0000 7f84832af640 1 -- 172.21.15.12:0/3160965576 wait complete. 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.535+0000 7f84832af640 1 Processor -- start 2024-09-10T09:22:48.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.535+0000 7f84832af640 1 -- start start 2024-09-10T09:22:48.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.535+0000 7f84832af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c0cef90 0x7f847c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.535+0000 7f84832af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15e940 0x7f847c148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.535+0000 7f84832af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 0x7f847c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f84832af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f847c0d3f00 con 0x7f847c15ed20 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f84832af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f847c0d3c20 con 0x7f847c0cef90 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f84832af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f847c0d3310 con 0x7f847c15e940 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 0x7f847c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 0x7f847c0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46136/0 (socket says 172.21.15.12:46136) 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 -- 172.21.15.12:0/3078686085 learned_addr learned my addr 172.21.15.12:0/3078686085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848104b640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c0cef90 0x7f847c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848084a640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15e940 0x7f847c148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 -- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15e940 msgr2=0x7f847c148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15e940 0x7f847c148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 -- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c0cef90 msgr2=0x7f847c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c0cef90 0x7f847c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 -- 172.21.15.12:0/3078686085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c0cd260 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848084a640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15e940 0x7f847c148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f848184c640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 0x7f847c0cda20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f846c00cb10 tx=0x7f846c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c017070 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c00ac10 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c0ab240 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c012400 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.536+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c0ab800 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.537+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847c0d1ef0 con 0x7f847c15ed20 2024-09-10T09:22:48.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.538+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f846c01a070 con 0x7f847c15ed20 2024-09-10T09:22:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.538+0000 7f8479ffb640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f846806be30 0x7f846806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.539+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f846c08ac30 con 0x7f847c15ed20 2024-09-10T09:22:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.539+0000 7f848104b640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f846806be30 0x7f846806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.539+0000 7f848104b640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f846806be30 0x7f846806e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8474034000 tx=0x7f847402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.543+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f847c0b7170 con 0x7f847c15ed20 2024-09-10T09:22:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.758+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f847c0ba6b0 con 0x7f847c15ed20 2024-09-10T09:22:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.758+0000 7f8479ffb640 1 -- 172.21.15.12:0/3078686085 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f846c058ef0 con 0x7f847c15ed20 2024-09-10T09:22:48.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:48.759 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:22:48.759 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:22:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f846806be30 msgr2=0x7f846806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f846806be30 0x7f846806e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8474034000 tx=0x7f847402e000 comp rx=0 tx=0).stop 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 msgr2=0x7f847c0cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 0x7f847c0cda20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f846c00cb10 tx=0x7f846c00a060 comp rx=0 tx=0).stop 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 shutdown_connections 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f846806be30 0x7f846806e2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f847c15ed20 0x7f847c0cda20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f847c15e940 0x7f847c148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 --2- 172.21.15.12:0/3078686085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f847c0cef90 0x7f847c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 >> 172.21.15.12:0/3078686085 conn(0x7f847c0b6240 msgr2=0x7f847c160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 shutdown_connections 2024-09-10T09:22:48.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.760+0000 7f84832af640 1 -- 172.21.15.12:0/3078686085 wait complete. 2024-09-10T09:22:48.772 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.874+0000 7f07a63d6640 1 Processor -- start 2024-09-10T09:22:48.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.874+0000 7f07a63d6640 1 -- start start 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a63d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07a00b8f90 0x7f07a00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a63d6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07a00b7170 con 0x7f07a015e940 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a63d6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07a00b7aa0 con 0x7f07a015ed20 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a63d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f07a00d3660 con 0x7f07a00b8f90 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f079ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f07a015e940 0x7f07a00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51744/0 (socket says 172.21.15.12:51744) 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f079ffff640 1 -- 172.21.15.12:0/1052866532 learned_addr learned my addr 172.21.15.12:0/1052866532 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a4973640 1 --2- 172.21.15.12:0/1052866532 >> v2:172.21.15.100:3300/0 conn(0x7f07a00b8f90 0x7f07a00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f079effd640 1 -- 172.21.15.12:0/1052866532 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400643437 0 0) 0x7f0790001110 con 0x7f07a015e940 2024-09-10T09:22:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f079effd640 1 -- 172.21.15.12:0/1052866532 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0788003520 con 0x7f07a015e940 2024-09-10T09:22:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a4973640 1 -- 172.21.15.12:0/1052866532 >> v1:172.21.15.100:6789/0 conn(0x7f07a015ed20 legacy=0x7f07a00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a4973640 1 -- 172.21.15.12:0/1052866532 >> v1:172.21.15.12:6789/0 conn(0x7f07a015e940 legacy=0x7f07a00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.875+0000 7f07a4973640 1 -- 172.21.15.12:0/1052866532 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a00d3940 con 0x7f07a00b8f90 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.876+0000 7f07a4973640 1 --2- 172.21.15.12:0/1052866532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a00b3930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0798009d90 tx=0x7f079802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df5203bf85c6280 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.876+0000 7f079effd640 1 -- 172.21.15.12:0/1052866532 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798037070 con 0x7f07a00b8f90 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.876+0000 7f079effd640 1 -- 172.21.15.12:0/1052866532 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0798007740 con 0x7f07a00b8f90 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.876+0000 7f079effd640 1 -- 172.21.15.12:0/1052866532 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798007b10 con 0x7f07a00b8f90 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 -- 172.21.15.12:0/1052866532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 msgr2=0x7f07a00b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 --2- 172.21.15.12:0/1052866532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a00b3930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0798009d90 tx=0x7f079802a780 comp rx=0 tx=0).stop 2024-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 -- 172.21.15.12:0/1052866532 shutdown_connections 2024-09-10T09:22:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 --2- 172.21.15.12:0/1052866532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a00b3930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 -- 172.21.15.12:0/1052866532 >> 172.21.15.12:0/1052866532 conn(0x7f07a00b6240 msgr2=0x7f07a00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 -- 172.21.15.12:0/1052866532 shutdown_connections 2024-09-10T09:22:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.877+0000 7f07a63d6640 1 -- 172.21.15.12:0/1052866532 wait complete. 2024-09-10T09:22:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.878+0000 7f07a63d6640 1 Processor -- start 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.878+0000 7f07a63d6640 1 -- start start 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a63d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a0157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a63d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07a015e940 0x7f07a015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a63d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 0x7f07a014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a63d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f07a00d3310 con 0x7f07a015ed20 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a63d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07a00d3f00 con 0x7f07a00b8f90 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a63d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f07a00d1ef0 con 0x7f07a015e940 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 0x7f07a014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 0x7f07a014e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46148/0 (socket says 172.21.15.12:46148) 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 -- 172.21.15.12:0/3401987860 learned_addr learned my addr 172.21.15.12:0/3401987860 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f079ffff640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a0157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f079f7fe640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07a015e940 0x7f07a015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 -- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07a015e940 msgr2=0x7f07a015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07a015e940 0x7f07a015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 -- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 msgr2=0x7f07a0157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a0157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 -- 172.21.15.12:0/3401987860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a01f8390 con 0x7f07a015ed20 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f079f7fe640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07a015e940 0x7f07a015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.879+0000 7f07a4973640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 0x7f07a014e700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0798009d90 tx=0x7f0798004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.880+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798042020 con 0x7f07a015ed20 2024-09-10T09:22:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.880+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980327f0 con 0x7f07a015ed20 2024-09-10T09:22:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.880+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a01f8670 con 0x7f07a015ed20 2024-09-10T09:22:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.880+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798037040 con 0x7f07a015ed20 2024-09-10T09:22:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.880+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a01f8c30 con 0x7f07a015ed20 2024-09-10T09:22:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.881+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a0073720 con 0x7f07a015ed20 2024-09-10T09:22:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.881+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0798045020 con 0x7f07a015ed20 2024-09-10T09:22:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.881+0000 7f079cff9640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f078c06be30 0x7f078c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.882+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07980abf70 con 0x7f07a015ed20 2024-09-10T09:22:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.882+0000 7f079ffff640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f078c06be30 0x7f078c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.882+0000 7f079ffff640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f078c06be30 0x7f078c06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0790007fd0 tx=0x7f0790009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:48.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:48.886+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07a0073720 con 0x7f07a015ed20 2024-09-10T09:22:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.063+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07a00cef90 con 0x7f07a015ed20 2024-09-10T09:22:49.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.065+0000 7f079cff9640 1 -- 172.21.15.12:0/3401987860 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f079804c030 con 0x7f07a015ed20 2024-09-10T09:22:49.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:49.066 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f078c06be30 msgr2=0x7f078c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f078c06be30 0x7f078c06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0790007fd0 tx=0x7f0790009040 comp rx=0 tx=0).stop 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 msgr2=0x7f07a014e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 0x7f07a014e700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0798009d90 tx=0x7f0798004a40 comp rx=0 tx=0).stop 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 shutdown_connections 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f078c06be30 0x7f078c06e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a015ed20 0x7f07a014e700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07a015e940 0x7f07a015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 --2- 172.21.15.12:0/3401987860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07a00b8f90 0x7f07a0157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 >> 172.21.15.12:0/3401987860 conn(0x7f07a00b6240 msgr2=0x7f07a00b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 shutdown_connections 2024-09-10T09:22:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.067+0000 7f07a63d6640 1 -- 172.21.15.12:0/3401987860 wait complete. 2024-09-10T09:22:49.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:22:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.180+0000 7f8e0c00e640 1 Processor -- start 2024-09-10T09:22:49.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.181+0000 7f8e0c00e640 1 -- start start 2024-09-10T09:22:49.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.181+0000 7f8e0c00e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e0415ed20 0x7f8e040b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.181+0000 7f8e0c00e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e040b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.181+0000 7f8e0c00e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e040b7170 con 0x7f8e0415e940 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.181+0000 7f8e0c00e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8e040b7aa0 con 0x7f8e0415ed20 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.181+0000 7f8e0c00e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8e040d3660 con 0x7f8e040cef90 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e095a9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e0415ed20 0x7f8e040b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e09daa640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8e0415e940 0x7f8e040d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51758/0 (socket says 172.21.15.12:51758) 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e09daa640 1 -- 172.21.15.12:0/516906423 learned_addr learned my addr 172.21.15.12:0/516906423 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e08da8640 1 -- 172.21.15.12:0/516906423 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515282704 0 0) 0x7f8dfc001110 con 0x7f8e0415e940 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e0a5ab640 1 --2- 172.21.15.12:0/516906423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e040b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e08da8640 1 -- 172.21.15.12:0/516906423 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dec003520 con 0x7f8e0415e940 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e095a9640 1 -- 172.21.15.12:0/516906423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 msgr2=0x7f8e040b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e095a9640 1 --2- 172.21.15.12:0/516906423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e040b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e095a9640 1 -- 172.21.15.12:0/516906423 >> v1:172.21.15.12:6789/0 conn(0x7f8e0415e940 legacy=0x7f8e040d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.182+0000 7f8e095a9640 1 -- 172.21.15.12:0/516906423 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e040d3940 con 0x7f8e0415ed20 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e095a9640 1 --2- 172.21.15.12:0/516906423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415ed20 0x7f8e040b3220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8df80097a0 tx=0x7f8df802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127d016b4fdecd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e08da8640 1 -- 172.21.15.12:0/516906423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8037070 con 0x7f8e0415ed20 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e08da8640 1 -- 172.21.15.12:0/516906423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df8032440 con 0x7f8e0415ed20 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e08da8640 1 -- 172.21.15.12:0/516906423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8032810 con 0x7f8e0415ed20 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 -- 172.21.15.12:0/516906423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415ed20 msgr2=0x7f8e040b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/516906423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415ed20 0x7f8e040b3220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8df80097a0 tx=0x7f8df802a210 comp rx=0 tx=0).stop 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 -- 172.21.15.12:0/516906423 shutdown_connections 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/516906423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e040b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/516906423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415ed20 0x7f8e040b3220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 -- 172.21.15.12:0/516906423 >> 172.21.15.12:0/516906423 conn(0x7f8e040b6240 msgr2=0x7f8e040b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 -- 172.21.15.12:0/516906423 shutdown_connections 2024-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.183+0000 7f8e0c00e640 1 -- 172.21.15.12:0/516906423 wait complete. 2024-09-10T09:22:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 Processor -- start 2024-09-10T09:22:49.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 -- start start 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e041f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 0x7f8e041584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e0415ed20 0x7f8e040b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040d3310 con 0x7f8e0415e940 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040d3f00 con 0x7f8e0415ed20 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e0c00e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8e040d1ef0 con 0x7f8e040cef90 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e095a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 0x7f8e041584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e095a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 0x7f8e041584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46176/0 (socket says 172.21.15.12:46176) 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.185+0000 7f8e095a9640 1 -- 172.21.15.12:0/2831414206 learned_addr learned my addr 172.21.15.12:0/2831414206 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e09daa640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e041f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e0a5ab640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e0415ed20 0x7f8e040b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e095a9640 1 -- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 msgr2=0x7f8e041f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e095a9640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e041f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e095a9640 1 -- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e0415ed20 msgr2=0x7f8e040b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e095a9640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e0415ed20 0x7f8e040b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e095a9640 1 -- 172.21.15.12:0/2831414206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04158a10 con 0x7f8e0415e940 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e095a9640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 0x7f8e041584d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8df8035040 tx=0x7f8df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8037040 con 0x7f8e0415e940 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df8030500 con 0x7f8e0415e940 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e04158c90 con 0x7f8e0415e940 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8030910 con 0x7f8e0415e940 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.186+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e04159250 con 0x7f8e0415e940 2024-09-10T09:22:49.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.187+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040d1060 con 0x7f8e0415e940 2024-09-10T09:22:49.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.188+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8df8044020 con 0x7f8e0415e940 2024-09-10T09:22:49.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.188+0000 7f8e027fc640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8df006be30 0x7f8df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.188+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8df80aafd0 con 0x7f8e0415e940 2024-09-10T09:22:49.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.188+0000 7f8e09daa640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8df006be30 0x7f8df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.189+0000 7f8e09daa640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8df006be30 0x7f8df006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc005880 tx=0x7f8dfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.192+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e04158a10 con 0x7f8e0415e940 2024-09-10T09:22:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.402+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e040ba6b0 con 0x7f8e0415e940 2024-09-10T09:22:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.403+0000 7f8e027fc640 1 -- 172.21.15.12:0/2831414206 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f8df8079330 con 0x7f8e0415e940 2024-09-10T09:22:49.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:49.404 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:22:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:22:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8df006be30 msgr2=0x7f8df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8df006be30 0x7f8df006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc005880 tx=0x7f8dfc009040 comp rx=0 tx=0).stop 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 msgr2=0x7f8e041584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 0x7f8e041584d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8df8035040 tx=0x7f8df80046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 shutdown_connections 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8df006be30 0x7f8df006e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e0415ed20 0x7f8e040b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e0415e940 0x7f8e041584d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 --2- 172.21.15.12:0/2831414206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e040cef90 0x7f8e041f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 >> 172.21.15.12:0/2831414206 conn(0x7f8e040b6240 msgr2=0x7f8e04160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 shutdown_connections 2024-09-10T09:22:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.405+0000 7f8e0c00e640 1 -- 172.21.15.12:0/2831414206 wait complete. 2024-09-10T09:22:49.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T09:22:38.285526+0000', 'modified': '2024-09-10T09:22:41.208280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6837/4014482573', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 4014482573}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 4014482573}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4306, 'qdb_cluster': [4306]} 2024-09-10T09:22:49.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T09:22:49.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T09:22:49.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.925+0000 7f62ba3e4640 1 Processor -- start 2024-09-10T09:22:49.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.925+0000 7f62ba3e4640 1 -- start start 2024-09-10T09:22:49.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62ba3e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 0x7f62b40b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62ba3e4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b40b6b50 con 0x7f62b415e860 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62ba3e4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b40d34d0 con 0x7f62b40b7aa0 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62ba3e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f62b40d3790 con 0x7f62b40b61f0 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62b3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f62b415e860 0x7f62b40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51772/0 (socket says 172.21.15.12:51772) 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62b3fff640 1 -- 172.21.15.12:0/3510879365 learned_addr learned my addr 172.21.15.12:0/3510879365 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 0x7f62b40b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193219344 0 0) 0x7f62b40b6b50 con 0x7f62b415e860 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.926+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f629c003520 con 0x7f62b415e860 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 709169331 0 0) 0x7f629c003520 con 0x7f62b415e860 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 msgr2=0x7f62b40b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 0x7f62b40b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 >> v1:172.21.15.100:6789/0 conn(0x7f62b40b7aa0 legacy=0x7f62b40b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b40d3a70 con 0x7f62b415e860 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f62a4001670 con 0x7f62b415e860 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 >> v1:172.21.15.12:6789/0 conn(0x7f62b415e860 legacy=0x7f62b40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 0x7f629c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f629c003f20 0x7f629c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f629c004d40 0x7f629c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40d3790 con 0x7f629c003f20 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f629c00ba20 con 0x7f629c004d40 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f629c00bc20 con 0x7f62b40b61f0 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f629c003f20 0x7f629c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b3fff640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 0x7f629c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b8981640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f629c004d40 0x7f629c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b37fe640 1 -- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 msgr2=0x7f629c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b40b61f0 0x7f629c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b37fe640 1 -- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f629c004d40 msgr2=0x7f629c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f629c004d40 0x7f629c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.927+0000 7f62b37fe640 1 -- 172.21.15.12:0/3510879365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629c003520 con 0x7f629c003f20 2024-09-10T09:22:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.928+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f629c003f20 0x7f629c004800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009ac0 tx=0x7f629c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bef67c2954f32dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.928+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8036070 con 0x7f629c003f20 2024-09-10T09:22:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.928+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8031400 con 0x7f629c003f20 2024-09-10T09:22:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.928+0000 7f62b2ffd640 1 -- 172.21.15.12:0/3510879365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8009690 con 0x7f629c003f20 2024-09-10T09:22:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3510879365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f629c003f20 msgr2=0x7f629c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3510879365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f629c003f20 0x7f629c004800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009ac0 tx=0x7f629c005830 comp rx=0 tx=0).stop 2024-09-10T09:22:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62b8981640 1 -- 172.21.15.12:0/3510879365 reap_dead start 2024-09-10T09:22:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3510879365 shutdown_connections 2024-09-10T09:22:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3510879365 >> 172.21.15.12:0/3510879365 conn(0x7f62b4062c60 msgr2=0x7f62b40d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3510879365 shutdown_connections 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.929+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3510879365 wait complete. 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.930+0000 7f62ba3e4640 1 Processor -- start 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.930+0000 7f62ba3e4640 1 -- start start 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62ba3e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f629c003f20 0x7f62b4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62ba3e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 0x7f62b41f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62ba3e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b40cbf90 0x7f62b415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62ba3e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40d4310 con 0x7f62b41547c0 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62ba3e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40d4030 con 0x7f62b40cbf90 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62ba3e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f62b415ec40 con 0x7f629c003f20 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 0x7f62b41f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 0x7f62b41f4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46186/0 (socket says 172.21.15.12:46186) 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 -- 172.21.15.12:0/3102338278 learned_addr learned my addr 172.21.15.12:0/3102338278 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b3fff640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f629c003f20 0x7f62b4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b8981640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b40cbf90 0x7f62b415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 -- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f629c003f20 msgr2=0x7f62b4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f629c003f20 0x7f62b4157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 -- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b40cbf90 msgr2=0x7f62b415ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b40cbf90 0x7f62b415ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 -- 172.21.15.12:0/3102338278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b40cb7b0 con 0x7f62b41547c0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.931+0000 7f62b37fe640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 0x7f62b41f4460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62a8000c00 tx=0x7f62a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.932+0000 7f62b0ff9640 1 -- 172.21.15.12:0/3102338278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8040020 con 0x7f62b41547c0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.932+0000 7f62b0ff9640 1 -- 172.21.15.12:0/3102338278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8003c60 con 0x7f62b41547c0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.932+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b41f4cb0 con 0x7f62b41547c0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.932+0000 7f62b0ff9640 1 -- 172.21.15.12:0/3102338278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8036040 con 0x7f62b41547c0 2024-09-10T09:22:49.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.932+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b41f5270 con 0x7f62b41547c0 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.933+0000 7f62b0ff9640 1 -- 172.21.15.12:0/3102338278 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62a8043020 con 0x7f62b41547c0 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.934+0000 7f62b0ff9640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f62a006be30 0x7f62a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.934+0000 7f62b0ff9640 1 -- 172.21.15.12:0/3102338278 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62a80aae90 con 0x7f62b41547c0 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.934+0000 7f62b3fff640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f62a006be30 0x7f62a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.935+0000 7f62b3fff640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f62a006be30 0x7f62a006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62b40d2c70 tx=0x7f62a40078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.935+0000 7f62bd25a740 1 Processor -- start 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.935+0000 7f62bd25a740 1 -- start start 2024-09-10T09:22:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c9908ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 0x555c990476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c990418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62bd25a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555c98fa9520 con 0x555c99044a80 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c98f513e0 con 0x555c990472c0 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x555c98fa54e0 con 0x555c99048a50 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 0x555c990476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 0x555c990476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46194/0 (socket says 172.21.15.12:46194) 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c9908ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 -- 172.21.15.12:0/1289047331 learned_addr learned my addr 172.21.15.12:0/1289047331 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b8981640 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c990418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 -- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 msgr2=0x555c990418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c990418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 -- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 msgr2=0x555c9908ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c9908ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 -- 172.21.15.12:0/1289047331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c98f6c2f0 con 0x555c99044a80 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f62b37fe640 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 0x555c990476a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62a80a93f0 tx=0x7f62a8079a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e8da04b4e1a399 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f6299ffb640 1 -- 172.21.15.12:0/1289047331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8081db0 con 0x555c99044a80 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f6299ffb640 1 -- 172.21.15.12:0/1289047331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8077270 con 0x555c99044a80 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.936+0000 7f6299ffb640 1 -- 172.21.15.12:0/1289047331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a80774d0 con 0x555c99044a80 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 -- 172.21.15.12:0/1289047331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 msgr2=0x555c990476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 0x555c990476a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62a80a93f0 tx=0x7f62a8079a10 comp rx=0 tx=0).stop 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 -- 172.21.15.12:0/1289047331 shutdown_connections 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c990418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99044a80 0x555c990476a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1289047331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c9908ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 -- 172.21.15.12:0/1289047331 >> 172.21.15.12:0/1289047331 conn(0x555c99043a80 msgr2=0x555c9908bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 -- 172.21.15.12:0/1289047331 shutdown_connections 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.937+0000 7f62bd25a740 1 -- 172.21.15.12:0/1289047331 wait complete. 2024-09-10T09:22:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.938+0000 7f62bd25a740 1 -- start start 2024-09-10T09:22:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.938+0000 7f62bd25a740 1 Processor -- start 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.938+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c99070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c99048a50 0x555c99087aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c9905e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555c98fa54e0 con 0x555c9905daf0 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c98f32450 con 0x555c99048a50 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x555c98fa9520 con 0x555c990472c0 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 10 client.0 _ll_register_callbacks cb 0x555c98cbbac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c9905e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c9905e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46206/0 (socket says 172.21.15.12:46206) 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 -- 172.21.15.12:0/1786917653 learned_addr learned my addr 172.21.15.12:0/1786917653 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b37fe640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c99048a50 0x555c99087aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b3fff640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c99070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 -- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 msgr2=0x555c99070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c99070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 -- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c99048a50 msgr2=0x555c99087aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c99048a50 0x555c99087aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 -- 172.21.15.12:0/1786917653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c98cbc2d0 con 0x555c9905daf0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62b8981640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c9905e5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b38d0 tx=0x7f62ac015de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ccc91bd81e3dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f6292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f6292ffd640 1 -- 172.21.15.12:0/1786917653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac003b80 con 0x555c9905daf0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f6292ffd640 1 -- 172.21.15.12:0/1786917653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62ac003d20 con 0x555c9905daf0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a8077270 con 0x555c9905daf0 2024-09-10T09:22:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f6292ffd640 1 -- 172.21.15.12:0/1786917653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f62ac026050 con 0x555c9905daf0 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 10 client.4566 fetch_fsmap learned FSMap version 7 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.939+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555c98d866b0 con 0x555c9905daf0 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f6292ffd640 1 -- 172.21.15.12:0/1786917653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8077270 con 0x555c9905daf0 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f6292ffd640 1 -- 172.21.15.12:0/1786917653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f62ac029020 con 0x555c9905daf0 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62bd25a740 10 client.4566 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62bd25a740 10 client.4566 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62bd25a740 20 client.4566 populate_metadata read hostname 'smithi012' 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c99086560 0x555c99086940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62bd25a740 4 client.4566 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 --> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c98fb6c50 con 0x555c99086560 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62b3fff640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c99086560 0x555c99086940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f62b3fff640 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c99086560 0x555c99086940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3974aeb15120120b server_cookie=a2b15d6d4a167c94 in_seq=0 out_seq=0 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.940+0000 7f6292ffd640 10 client.4566 ms_handle_connect on v2:172.21.15.100:6836/4014482573 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.941+0000 7f6292ffd640 1 -- 172.21.15.12:0/1786917653 <== mds.0 v2:172.21.15.100:6836/4014482573 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c98fb6c50 con 0x555c99086560 2024-09-10T09:22:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.941+0000 7f6292ffd640 10 client.4566 handle_command_reply: tid=0 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.941+0000 7f62bd25a740 1 client.4566 shutdown 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.941+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 msgr2=0x555c9905e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.941+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c9905e5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b38d0 tx=0x7f62ac015de0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 shutdown_connections 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c99086560 0x555c99086940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c9905e5c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c99048a50 0x555c99087aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f6292ffd640 0 client.4566 ms_handle_reset on v2:172.21.15.100:6836/4014482573 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 --2- 172.21.15.12:0/1786917653 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c99070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 >> 172.21.15.12:0/1786917653 conn(0x555c99044a80 msgr2=0x555c99089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 shutdown_connections 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 1 -- 172.21.15.12:0/1786917653 wait complete. 2024-09-10T09:22:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.942+0000 7f62bd25a740 20 client.4566 trim_cache size 0 max 16384 2024-09-10T09:22:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 Processor -- start 2024-09-10T09:22:49.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 -- start start 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c9908a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 0x555c9908a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c9905daf0 0x555c990407d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62b4200210 con 0x555c99048a50 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f62b41f84e0 con 0x555c9905daf0 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f62b41ffbc0 con 0x555c990472c0 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 0x555c9908a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 0x555c9908a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46208/0 (socket says 172.21.15.12:46208) 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.960+0000 7f62b37fe640 1 -- 172.21.15.12:0/2904650032 learned_addr learned my addr 172.21.15.12:0/2904650032 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b3fff640 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c9908a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b8981640 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c9905daf0 0x555c990407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b37fe640 1 -- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 msgr2=0x555c9908a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b37fe640 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c9908a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b37fe640 1 -- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c9905daf0 msgr2=0x555c990407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b37fe640 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c9905daf0 0x555c990407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b37fe640 1 -- 172.21.15.12:0/2904650032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c99072a60 con 0x555c99048a50 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b8981640 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c9905daf0 0x555c990407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62b37fe640 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 0x555c9908a6e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62a808f040 tx=0x7f62a8047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcfca95b2be2140 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62997fa640 1 -- 172.21.15.12:0/2904650032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8081db0 con 0x555c99048a50 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62997fa640 1 -- 172.21.15.12:0/2904650032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a80a6070 con 0x555c99048a50 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62997fa640 1 -- 172.21.15.12:0/2904650032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8091180 con 0x555c99048a50 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62bd25a740 1 -- 172.21.15.12:0/2904650032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 msgr2=0x555c9908a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.961+0000 7f62bd25a740 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 0x555c9908a6e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62a808f040 tx=0x7f62a8047000 comp rx=0 tx=0).stop 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 -- 172.21.15.12:0/2904650032 shutdown_connections 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c9905daf0 0x555c990407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c99048a50 0x555c9908a6e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 --2- 172.21.15.12:0/2904650032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c990472c0 0x555c9908a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 -- 172.21.15.12:0/2904650032 >> 172.21.15.12:0/2904650032 conn(0x555c99044a80 msgr2=0x555c9908d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 -- 172.21.15.12:0/2904650032 shutdown_connections 2024-09-10T09:22:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 -- 172.21.15.12:0/2904650032 wait complete. 2024-09-10T09:22:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 -- start start 2024-09-10T09:22:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.962+0000 7f62bd25a740 1 Processor -- start 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c991038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c99109830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c99084d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555c9906fb60 con 0x555c9905daf0 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555c98f513e0 con 0x555c990472c0 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x555c9905e040 con 0x555c99048a50 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62bd25a740 10 client.0 _ll_register_callbacks cb 0x7f62ac001bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b8981640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c99084d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b8981640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c99084d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46216/0 (socket says 172.21.15.12:46216) 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b8981640 1 -- 172.21.15.12:0/143323005 learned_addr learned my addr 172.21.15.12:0/143323005 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b3fff640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c991038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b37fe640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c99109830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b8981640 1 -- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 msgr2=0x555c99109830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.963+0000 7f62b8981640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c99109830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62b8981640 1 -- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 msgr2=0x555c991038c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62b8981640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c991038c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62b8981640 1 -- 172.21.15.12:0/143323005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9910a180 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62b8981640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c99084d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62ac006d80 tx=0x7f62ac001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d0e9533dca3d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f6292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f6292ffd640 1 -- 172.21.15.12:0/143323005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac013a10 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f6292ffd640 1 -- 172.21.15.12:0/143323005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62ac013bb0 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a80a6070 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f6292ffd640 1 -- 172.21.15.12:0/143323005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f62ac036050 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 10 client.4572 fetch_fsmap learned FSMap version 7 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555c990853e0 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f6292ffd640 1 -- 172.21.15.12:0/143323005 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a80a6070 con 0x555c9905daf0 2024-09-10T09:22:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f6292ffd640 1 -- 172.21.15.12:0/143323005 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f62ac039020 con 0x555c9905daf0 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 10 client.4572 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 10 client.4572 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 20 client.4572 populate_metadata read hostname 'smithi012' 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c9908a810 0x555c99114e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 4 client.4572 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.964+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 --> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] -- command(tid 0: {"prefix": "status"}) -- 0x555c98fb0fa0 con 0x555c9908a810 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62b3fff640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c9908a810 0x555c99114e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62b3fff640 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c9908a810 0x555c99114e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efaefe5cd4c2e5e0 server_cookie=b9d59c1f06a5c9c5 in_seq=0 out_seq=0 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f6292ffd640 10 client.4572 ms_handle_connect on v2:172.21.15.100:6836/4014482573 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f6292ffd640 1 -- 172.21.15.12:0/143323005 <== mds.0 v2:172.21.15.100:6836/4014482573 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555c98fb0fa0 con 0x555c9908a810 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f6292ffd640 10 client.4572 handle_command_reply: tid=0 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 client.4572 shutdown 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 msgr2=0x555c99084d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c99084d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62ac006d80 tx=0x7f62ac001730 comp rx=0 tx=0).stop 2024-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 shutdown_connections 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:6836/4014482573,v1:172.21.15.100:6837/4014482573] conn(0x555c9908a810 0x555c99114e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c9905daf0 0x555c99084d30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f6292ffd640 0 client.4572 ms_handle_reset on v2:172.21.15.100:6836/4014482573 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x555c99048a50 0x555c99109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 --2- 172.21.15.12:0/143323005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555c990472c0 0x555c991038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 >> 172.21.15.12:0/143323005 conn(0x555c99044a80 msgr2=0x555c99088950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 shutdown_connections 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.965+0000 7f62bd25a740 1 -- 172.21.15.12:0/143323005 wait complete. 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62bd25a740 20 client.4572 trim_cache size 0 max 16384 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:22:49.972 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "b13fea51-e2df-43f6-8889-422976fa1401", 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4306, 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.013344014999999, 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 21, 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 21, 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.055490107000001 2024-09-10T09:22:49.973 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:22:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f62a006be30 msgr2=0x7f62a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f62a006be30 0x7f62a006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62b40d2c70 tx=0x7f62a40078f0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 msgr2=0x7f62b41f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 0x7f62b41f4460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62a8000c00 tx=0x7f62a8004730 comp rx=0 tx=0).stop 2024-09-10T09:22:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 shutdown_connections 2024-09-10T09:22:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f62a006be30 0x7f62a006e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b40cbf90 0x7f62b415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62b41547c0 0x7f62b41f4460 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 --2- 172.21.15.12:0/3102338278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f629c003f20 0x7f62b4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 >> 172.21.15.12:0/3102338278 conn(0x7f62b4062c60 msgr2=0x7f62b40b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 shutdown_connections 2024-09-10T09:22:49.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:49.966+0000 7f62ba3e4640 1 -- 172.21.15.12:0/3102338278 wait complete. 2024-09-10T09:22:49.978 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T09:22:49.988 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T09:22:49.988 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T09:22:49.988 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T09:22:49.988 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T09:22:50.011 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T09:22:50.011 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T09:22:50.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.011 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:22:50.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-10T09:22:50.095 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-10T09:22:50.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:22:50.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.097 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:22:50.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-10T09:22:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-10T09:22:50.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:22:50.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.220 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:22:50.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-10T09:22:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-09-10T09:22:50.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:22:50.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.314 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:22:50.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.372 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-10T09:22:50.440 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-09-10T09:22:50.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:22:50.442 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-10T09:22:50.442 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T09:22:50.442 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T09:22:50.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T09:22:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.546+0000 7faa1a00e640 1 Processor -- start 2024-09-10T09:22:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.546+0000 7faa1a00e640 1 -- start start 2024-09-10T09:22:50.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa1a00e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faa1415ed20 0x7faa140b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa1a00e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa140b7170 con 0x7faa140cef90 2024-09-10T09:22:50.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa1a00e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa140b7aa0 con 0x7faa1415e940 2024-09-10T09:22:50.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa1a00e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7faa140d3660 con 0x7faa1415ed20 2024-09-10T09:22:50.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa13fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faa140cef90 0x7faa140b3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51782/0 (socket says 172.21.15.12:51782) 2024-09-10T09:22:50.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa13fff640 1 -- 172.21.15.12:0/3175226936 learned_addr learned my addr 172.21.15.12:0/3175226936 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619424140 0 0) 0x7faa0c001490 con 0x7faa140cef90 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa00003520 con 0x7faa140cef90 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa12ffd640 1 --2- 172.21.15.12:0/3175226936 >> v2:172.21.15.100:3300/0 conn(0x7faa1415ed20 0x7faa140b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1892207800 0 0) 0x7faa00003520 con 0x7faa140cef90 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 >> v2:172.21.15.100:3300/0 conn(0x7faa1415ed20 msgr2=0x7faa140b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 --2- 172.21.15.12:0/3175226936 >> v2:172.21.15.100:3300/0 conn(0x7faa1415ed20 0x7faa140b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 >> v1:172.21.15.100:6789/0 conn(0x7faa1415e940 legacy=0x7faa140d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa140d3940 con 0x7faa140cef90 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.547+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7faa0c001bc0 con 0x7faa140cef90 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 >> v1:172.21.15.12:6789/0 conn(0x7faa140cef90 legacy=0x7faa140b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000039b0 0x7faa00003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa00004800 0x7faa00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa000051c0 0x7faa0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa140d3660 con 0x7faa000051c0 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa0000c0d0 con 0x7faa00004800 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7faa0000c2d0 con 0x7faa000039b0 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa13fff640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa000051c0 0x7faa0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa12ffd640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa00004800 0x7faa00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa137fe640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000039b0 0x7faa00003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa13fff640 1 -- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000039b0 msgr2=0x7faa00003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa13fff640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000039b0 0x7faa00003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa13fff640 1 -- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa00004800 msgr2=0x7faa00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa13fff640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa00004800 0x7faa00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.548+0000 7faa13fff640 1 -- 172.21.15.12:0/3175226936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa00003520 con 0x7faa000051c0 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa13fff640 1 -- 172.21.15.12:0/3175226936 reap_dead start 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa13fff640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa000051c0 0x7faa0000b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00aa50 tx=0x7faa00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f3d4ca5c6280a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00a670 con 0x7faa000051c0 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0c02f070 con 0x7faa000051c0 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa127fc640 1 -- 172.21.15.12:0/3175226936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c034470 con 0x7faa000051c0 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 -- 172.21.15.12:0/3175226936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa000051c0 msgr2=0x7faa0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa000051c0 0x7faa0000b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00aa50 tx=0x7faa00005830 comp rx=0 tx=0).stop 2024-09-10T09:22:50.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 -- 172.21.15.12:0/3175226936 shutdown_connections 2024-09-10T09:22:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3175226936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa000051c0 0x7faa0000b9c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 -- 172.21.15.12:0/3175226936 >> 172.21.15.12:0/3175226936 conn(0x7faa140b6240 msgr2=0x7faa140b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 -- 172.21.15.12:0/3175226936 shutdown_connections 2024-09-10T09:22:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.549+0000 7faa1a00e640 1 -- 172.21.15.12:0/3175226936 wait complete. 2024-09-10T09:22:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 Processor -- start 2024-09-10T09:22:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 -- start start 2024-09-10T09:22:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000051c0 0x7faa14158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 0x7faa1415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa141f5e60 0x7faa1415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa140d1ef0 con 0x7faa141f59e0 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa140d3f00 con 0x7faa141f5e60 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.551+0000 7faa1a00e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7faa140d2070 con 0x7faa000051c0 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 0x7faa1415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 0x7faa1415aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46234/0 (socket says 172.21.15.12:46234) 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 -- 172.21.15.12:0/3761988020 learned_addr learned my addr 172.21.15.12:0/3761988020 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa13fff640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa141f5e60 0x7faa1415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa137fe640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000051c0 0x7faa14158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 -- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000051c0 msgr2=0x7faa14158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000051c0 0x7faa14158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 -- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa141f5e60 msgr2=0x7faa1415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa141f5e60 0x7faa1415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 -- 172.21.15.12:0/3761988020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa140c9980 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa137fe640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000051c0 0x7faa14158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa12ffd640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 0x7faa1415aa60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b5c0 tx=0x7fa9fc00ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc018070 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc010700 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa140c9c60 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc010ad0 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.552+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa140ca220 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.553+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa140d1060 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.554+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9fc01b070 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.554+0000 7faa0bfff640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9f406be30 0x7fa9f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.554+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa9fc08b130 con 0x7faa141f59e0 2024-09-10T09:22:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.554+0000 7faa137fe640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9f406be30 0x7fa9f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.555+0000 7faa137fe640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9f406be30 0x7fa9f406e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa140cc130 tx=0x7faa04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.558+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9fc059b70 con 0x7faa141f59e0 2024-09-10T09:22:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.774+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faa140ba6b0 con 0x7faa141f59e0 2024-09-10T09:22:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.774+0000 7faa0bfff640 1 -- 172.21.15.12:0/3761988020 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa9fc059470 con 0x7faa141f59e0 2024-09-10T09:22:50.775 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9f406be30 msgr2=0x7fa9f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9f406be30 0x7fa9f406e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa140cc130 tx=0x7faa04009040 comp rx=0 tx=0).stop 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 msgr2=0x7faa1415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 0x7faa1415aa60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b5c0 tx=0x7fa9fc00ba80 comp rx=0 tx=0).stop 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 shutdown_connections 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9f406be30 0x7fa9f406e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa141f5e60 0x7faa1415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa141f59e0 0x7faa1415aa60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 --2- 172.21.15.12:0/3761988020 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa000051c0 0x7faa14158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 >> 172.21.15.12:0/3761988020 conn(0x7faa140b6240 msgr2=0x7faa1415f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 shutdown_connections 2024-09-10T09:22:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50.776+0000 7faa1a00e640 1 -- 172.21.15.12:0/3761988020 wait complete. 2024-09-10T09:22:50.787 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:22:50.788 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:22:50.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:50.789 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:50.805 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42743sec preferred_lft 42743sec 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:50.806 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:50.807 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-10T09:22:50.807 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T09:22:50.807 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:50.807 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:50.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-09-10T09:22:50.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-09-10T09:22:50.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-09-10T09:22:50.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T09:22:50.808 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:51.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:51.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:51.018 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:22:51.045 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-10T09:22:51.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:51.046 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-10T09:22:51.124 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-10T09:22:51.124 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:22:51.125 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T09:22:51.125 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T09:22:51.125 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:22:51.127 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:51.127 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:51.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T09:22:51.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T09:22:51.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T09:22:51.128 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:51.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:51.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:51.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:51.428 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:22:51.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:51.445 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-10T09:22:51.500 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:51.500 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:51.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T09:22:51.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T09:22:51.501 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:51.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:51.620 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T09:22:51.620 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:51.620 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:51.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T09:22:51.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T09:22:51.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T09:22:51.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T09:22:51.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T09:22:51.621 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:51.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:51.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:51.746 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:51.746 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:51.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-10T09:22:51.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T09:22:51.747 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:51.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:51.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:51.826 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T09:22:51.841 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:22:51.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:51.842 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T09:22:51.897 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:22:51.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:51.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:22:51.998 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:22:51.998 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:22:51.998 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:22:52.138 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:22:52.138 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:22:52.139 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:22:52.139 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:52.139 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:52.148 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790" 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790:/ 2024-09-10T09:22:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=b13fea51-e2df-43f6-8889-422976fa1401" will pass to kernel 2024-09-10T09:22:52.150 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T09:22:52.150 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:22:52.150 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:22:52.150 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:22:52.150 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:22:52.151 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:22:52.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:52.151 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T09:22:52.178 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:52.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:52.284 INFO:teuthology.orchestra.run.smithi012.stdout:client4581 2024-09-10T09:22:52.284 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:52.284 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:22:52.301 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:52.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:52.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:52.409 INFO:teuthology.orchestra.run.smithi012.stdout:client4581 2024-09-10T09:22:52.409 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:52.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:52.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:52.475 INFO:teuthology.orchestra.run.smithi012.stdout:client4581 2024-09-10T09:22:52.476 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b13fea51-e2df-43f6-8889-422976fa1401.client4581/status') 2024-09-10T09:22:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:52.542 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.4581 (3)192.168.0.1:0/4267948338 2024-09-10T09:22:52.542 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-09-10T09:22:52.543 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-09-10T09:22:52.543 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-09-10T09:22:52.543 INFO:teuthology.orchestra.run.smithi012.stderr:69 bytes copied, 2.4277e-05 s, 2.8 MB/s 2024-09-10T09:22:52.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:52.550 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-10T09:22:52.550 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T09:22:52.550 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T09:22:52.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T09:22:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.652+0000 7f698b342640 1 Processor -- start 2024-09-10T09:22:52.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.652+0000 7f698b342640 1 -- start start 2024-09-10T09:22:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.653+0000 7f698b342640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f698415c5e0 0x7f69840712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.653+0000 7f698b342640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6984160f00 con 0x7f69840b6d50 2024-09-10T09:22:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.653+0000 7f698b342640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698415c9c0 con 0x7f69840b66e0 2024-09-10T09:22:52.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.653+0000 7f698b342640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6984074100 con 0x7f698415c5e0 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69890de640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f698415c5e0 0x7f69840712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69888dd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f69840b6d50 0x7f69841600e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60182/0 (socket says 172.21.15.12:60182) 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69888dd640 1 -- 172.21.15.12:0/2286020662 learned_addr learned my addr 172.21.15.12:0/2286020662 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69890de640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f698415c5e0 0x7f69840712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38644/0 (socket says 172.21.15.12:38644) 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69890de640 1 -- 172.21.15.12:0/2286020662 >> v1:172.21.15.100:6789/0 conn(0x7f69840b66e0 legacy=0x7f69841607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69890de640 1 -- 172.21.15.12:0/2286020662 >> v1:172.21.15.12:6789/0 conn(0x7f69840b6d50 legacy=0x7f69841600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f69890de640 1 -- 172.21.15.12:0/2286020662 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69840b1dd0 con 0x7f698415c5e0 2024-09-10T09:22:52.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.654+0000 7f6983fff640 1 -- 172.21.15.12:0/2286020662 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405882302 0 0) 0x7f6984160f00 con 0x7f69840b6d50 2024-09-10T09:22:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f69890de640 1 --2- 172.21.15.12:0/2286020662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f698415c5e0 0x7f69840712b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f697c0097a0 tx=0x7f697c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6215ddc38e61cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f6983fff640 1 -- 172.21.15.12:0/2286020662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c037070 con 0x7f698415c5e0 2024-09-10T09:22:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f6983fff640 1 -- 172.21.15.12:0/2286020662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c032440 con 0x7f698415c5e0 2024-09-10T09:22:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f6983fff640 1 -- 172.21.15.12:0/2286020662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c032810 con 0x7f698415c5e0 2024-09-10T09:22:52.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 -- 172.21.15.12:0/2286020662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f698415c5e0 msgr2=0x7f69840712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 --2- 172.21.15.12:0/2286020662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f698415c5e0 0x7f69840712b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f697c0097a0 tx=0x7f697c02a230 comp rx=0 tx=0).stop 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 -- 172.21.15.12:0/2286020662 shutdown_connections 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 --2- 172.21.15.12:0/2286020662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f698415c5e0 0x7f69840712b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 -- 172.21.15.12:0/2286020662 >> 172.21.15.12:0/2286020662 conn(0x7f69840b4220 msgr2=0x7f69840b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 -- 172.21.15.12:0/2286020662 shutdown_connections 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.655+0000 7f698b342640 1 -- 172.21.15.12:0/2286020662 wait complete. 2024-09-10T09:22:52.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.657+0000 7f698b342640 1 Processor -- start 2024-09-10T09:22:52.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.657+0000 7f698b342640 1 -- start start 2024-09-10T09:22:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.657+0000 7f698b342640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 0x7f698415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:52.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.657+0000 7f698b342640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69840b6d50 0x7f6984159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f698b342640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698415c5e0 0x7f6984150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f698b342640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6984073ab0 con 0x7f69840b66e0 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f698b342640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69840737d0 con 0x7f698415c5e0 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f698b342640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6984073d90 con 0x7f69840b6d50 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 0x7f698415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 0x7f698415ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38660/0 (socket says 172.21.15.12:38660) 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 -- 172.21.15.12:0/3266179436 learned_addr learned my addr 172.21.15.12:0/3266179436 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69898df640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698415c5e0 0x7f6984150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69888dd640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69840b6d50 0x7f6984159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 -- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69840b6d50 msgr2=0x7f6984159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69840b6d50 0x7f6984159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 -- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698415c5e0 msgr2=0x7f6984150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698415c5e0 0x7f6984150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 -- 172.21.15.12:0/3266179436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698415b510 con 0x7f69840b66e0 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69898df640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698415c5e0 0x7f6984150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f69890de640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 0x7f698415ada0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f697c035040 tx=0x7f697c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c037050 con 0x7f69840b66e0 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c038040 con 0x7f69840b66e0 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c004450 con 0x7f69840b66e0 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.658+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698415b7f0 con 0x7f69840b66e0 2024-09-10T09:22:52.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.659+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69841529d0 con 0x7f69840b66e0 2024-09-10T09:22:52.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.659+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6984073130 con 0x7f69840b66e0 2024-09-10T09:22:52.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.660+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f697c030900 con 0x7f69840b66e0 2024-09-10T09:22:52.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.660+0000 7f6981ffb640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f697006be30 0x7f697006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:52.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.660+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f697c0abab0 con 0x7f69840b66e0 2024-09-10T09:22:52.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.661+0000 7f69888dd640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f697006be30 0x7f697006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:52.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.661+0000 7f69888dd640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f697006be30 0x7f697006e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f69841528c0 tx=0x7f6978007b90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:52.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.665+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f697c07a450 con 0x7f69840b66e0 2024-09-10T09:22:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.878+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6984070a30 con 0x7f69840b66e0 2024-09-10T09:22:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.878+0000 7f6981ffb640 1 -- 172.21.15.12:0/3266179436 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f697c079d50 con 0x7f69840b66e0 2024-09-10T09:22:52.879 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f697006be30 msgr2=0x7f697006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f697006be30 0x7f697006e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f69841528c0 tx=0x7f6978007b90 comp rx=0 tx=0).stop 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 msgr2=0x7f698415ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 0x7f698415ada0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f697c035040 tx=0x7f697c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 shutdown_connections 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f697006be30 0x7f697006e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f698415c5e0 0x7f6984150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69840b6d50 0x7f6984159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 --2- 172.21.15.12:0/3266179436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69840b66e0 0x7f698415ada0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 >> 172.21.15.12:0/3266179436 conn(0x7f69840b4220 msgr2=0x7f698415f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 shutdown_connections 2024-09-10T09:22:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:52.880+0000 7f698b342640 1 -- 172.21.15.12:0/3266179436 wait complete. 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:22:52.892 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T09:22:52.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:52.892 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-10T09:22:52.908 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-10T09:22:52.909 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:22:52.910 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 2a:0e:de:dd:8d:e3 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a42d:f8ff:fe27:99f/64 scope link 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 2a:0e:de:dd:8d:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::280e:deff:fedd:8de3/64 scope link tentative 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:52.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:52.911 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:22:52.972 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-10T09:22:52.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:52.974 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-10T09:22:53.032 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-10T09:22:53.032 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:22:53.032 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T09:22:53.032 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T09:22:53.032 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:22:53.032 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:53.033 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:53.033 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T09:22:53.033 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T09:22:53.033 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T09:22:53.033 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:53.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:53.162 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:22:53.177 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T09:22:53.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:53.178 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-10T09:22:53.233 INFO:teuthology.orchestra.run.smithi012.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T09:22:53.234 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:53.234 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:53.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T09:22:53.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T09:22:53.234 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:53.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:53.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:53.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T09:22:53.377 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether b6:8b:a7:53:3b:15 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::b48b:a7ff:fe53:3b15/64 scope link 2024-09-10T09:22:53.378 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:53.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T09:22:53.445 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:53.445 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether b6:8b:a7:53:3b:15 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::b48b:a7ff:fe53:3b15/64 scope link 2024-09-10T09:22:53.446 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:53.447 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T09:22:53.448 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:53.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:53.603 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:53.603 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:22:53.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-10T09:22:53.604 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T09:22:53.604 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:22:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:53.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:53.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:53.682 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T09:22:53.698 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T09:22:53.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:53.698 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T09:22:53.754 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:22:53.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:53.755 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T09:22:53.839 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T09:22:53.839 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-10T09:22:53.839 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:22:53.848 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T09:22:53.848 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-10T09:22:53.848 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:22:53.848 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:53.848 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790" 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790:/ 2024-09-10T09:22:53.853 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=b13fea51-e2df-43f6-8889-422976fa1401" will pass to kernel 2024-09-10T09:22:53.854 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-10T09:22:53.854 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:22:53.854 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:22:53.854 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:22:53.854 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:22:53.855 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:22:53.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:53.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T09:22:53.881 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:53.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:53.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:53.980 INFO:teuthology.orchestra.run.smithi012.stdout:client4460 2024-09-10T09:22:53.981 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:22:53.981 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:22:53.998 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:54.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:54.096 INFO:teuthology.orchestra.run.smithi012.stdout:client4460 2024-09-10T09:22:54.096 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:client4460 2024-09-10T09:22:54.154 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b13fea51-e2df-43f6-8889-422976fa1401.client4460/status') 2024-09-10T09:22:54.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:54.213 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.4460 (3)172.21.15.12:0/4282056514 2024-09-10T09:22:54.213 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-09-10T09:22:54.213 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-09-10T09:22:54.213 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-09-10T09:22:54.213 INFO:teuthology.orchestra.run.smithi012.stderr:70 bytes copied, 2.4431e-05 s, 2.9 MB/s 2024-09-10T09:22:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:54.221 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-10T09:22:54.221 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T09:22:54.221 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T09:22:54.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T09:22:54.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.322+0000 7fa37e8ba640 1 Processor -- start 2024-09-10T09:22:54.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.323+0000 7fa37e8ba640 1 -- start start 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.323+0000 7fa37e8ba640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa378151c50 0x7fa3780cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.323+0000 7fa37e8ba640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa37806c1f0 0x7fa37815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa37e8ba640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780cd5f0 con 0x7fa37806be10 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa37e8ba640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa3780cd8d0 con 0x7fa378151c50 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa37e8ba640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780cdbb0 con 0x7fa37806c1f0 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa378151c50 0x7fa3780cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa378151c50 0x7fa3780cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38670/0 (socket says 172.21.15.12:38670) 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 -- 172.21.15.12:0/3772529263 learned_addr learned my addr 172.21.15.12:0/3772529263 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa37ce57640 1 --2- 172.21.15.12:0/3772529263 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa37806c1f0 0x7fa37815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 -- 172.21.15.12:0/3772529263 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa37806c1f0 msgr2=0x7fa37815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 --2- 172.21.15.12:0/3772529263 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa37806c1f0 0x7fa37815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 -- 172.21.15.12:0/3772529263 >> v1:172.21.15.100:6789/0 conn(0x7fa37806be10 legacy=0x7fa378151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:54.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.324+0000 7fa3777fe640 1 -- 172.21.15.12:0/3772529263 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780cde90 con 0x7fa378151c50 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.325+0000 7fa3777fe640 1 --2- 172.21.15.12:0/3772529263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa378151c50 0x7fa3780cd010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5c41a95e488b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.325+0000 7fa376ffd640 1 -- 172.21.15.12:0/3772529263 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c037070 con 0x7fa378151c50 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.325+0000 7fa376ffd640 1 -- 172.21.15.12:0/3772529263 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c032440 con 0x7fa378151c50 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.325+0000 7fa376ffd640 1 -- 172.21.15.12:0/3772529263 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c032810 con 0x7fa378151c50 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.325+0000 7fa37e8ba640 1 -- 172.21.15.12:0/3772529263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa378151c50 msgr2=0x7fa3780cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.325+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/3772529263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa378151c50 0x7fa3780cd010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c02a270 comp rx=0 tx=0).stop 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.326+0000 7fa37e8ba640 1 -- 172.21.15.12:0/3772529263 shutdown_connections 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.326+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/3772529263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa378151c50 0x7fa3780cd010 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.326+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/3772529263 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa37806c1f0 0x7fa37815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.326+0000 7fa37e8ba640 1 -- 172.21.15.12:0/3772529263 >> 172.21.15.12:0/3772529263 conn(0x7fa378062cc0 msgr2=0x7fa37806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.326+0000 7fa37e8ba640 1 -- 172.21.15.12:0/3772529263 shutdown_connections 2024-09-10T09:22:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.326+0000 7fa37e8ba640 1 -- 172.21.15.12:0/3772529263 wait complete. 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.327+0000 7fa37e8ba640 1 Processor -- start 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.327+0000 7fa37e8ba640 1 -- start start 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37e8ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa37806be10 0x7fa3781f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37e8ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 0x7fa3781f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37e8ba640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa378151c50 0x7fa378155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37e8ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780d0310 con 0x7fa37806c1f0 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37e8ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780ce690 con 0x7fa37806be10 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37e8ba640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780d0490 con 0x7fa378151c50 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 0x7fa3781f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 0x7fa3781f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38672/0 (socket says 172.21.15.12:38672) 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 -- 172.21.15.12:0/2656190228 learned_addr learned my addr 172.21.15.12:0/2656190228 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa37ce57640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa378151c50 0x7fa378155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa377fff640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa37806be10 0x7fa3781f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 -- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa378151c50 msgr2=0x7fa378155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa378151c50 0x7fa378155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 -- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa37806be10 msgr2=0x7fa3781f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa37806be10 0x7fa3781f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 -- 172.21.15.12:0/2656190228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378155ea0 con 0x7fa37806c1f0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa3777fe640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 0x7fa3781f4a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.328+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c03f070 con 0x7fa37806c1f0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.329+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c043600 con 0x7fa37806c1f0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.329+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0439f0 con 0x7fa37806c1f0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.329+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa378156180 con 0x7fa37806c1f0 2024-09-10T09:22:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.329+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa378156740 con 0x7fa37806c1f0 2024-09-10T09:22:54.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.330+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3780d0870 con 0x7fa37806c1f0 2024-09-10T09:22:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.330+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa36c04a060 con 0x7fa37806c1f0 2024-09-10T09:22:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.331+0000 7fa374ff9640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa36406be30 0x7fa36406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.331+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa36c0acb40 con 0x7fa37806c1f0 2024-09-10T09:22:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.331+0000 7fa377fff640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa36406be30 0x7fa36406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.331+0000 7fa377fff640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa36406be30 0x7fa36406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa368001780 tx=0x7fa368009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.335+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa36c07aea0 con 0x7fa37806c1f0 2024-09-10T09:22:54.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.546+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa3780d0070 con 0x7fa37806c1f0 2024-09-10T09:22:54.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.547+0000 7fa374ff9640 1 -- 172.21.15.12:0/2656190228 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa36c07f1a0 con 0x7fa37806c1f0 2024-09-10T09:22:54.548 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa36406be30 msgr2=0x7fa36406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa36406be30 0x7fa36406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa368001780 tx=0x7fa368009040 comp rx=0 tx=0).stop 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 msgr2=0x7fa3781f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 0x7fa3781f4a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 shutdown_connections 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa36406be30 0x7fa36406e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa378151c50 0x7fa378155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa37806c1f0 0x7fa3781f4a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 --2- 172.21.15.12:0/2656190228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa37806be10 0x7fa3781f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:54.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 >> 172.21.15.12:0/2656190228 conn(0x7fa378062cc0 msgr2=0x7fa37815d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:54.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 shutdown_connections 2024-09-10T09:22:54.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:54.549+0000 7fa37e8ba640 1 -- 172.21.15.12:0/2656190228 wait complete. 2024-09-10T09:22:54.560 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T09:22:54.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:22:54.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T09:22:54.561 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T09:22:54.561 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T09:22:54.561 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T09:22:54.561 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T09:22:54.561 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:22:54.561 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:22:54.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:54.561 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T09:22:54.580 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:54.580 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:54.581 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:22:54.582 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:54.582 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T09:22:54.582 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42777sec preferred_lft 42777sec 2024-09-10T09:22:54.582 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T09:22:54.582 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:54.582 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T09:22:54.582 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:54.582 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:54.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-10T09:22:54.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-10T09:22:54.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-10T09:22:54.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T09:22:54.583 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:54.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:54.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:54.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:54.854 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:22:54.879 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T09:22:54.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:54.881 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T09:22:54.956 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T09:22:54.956 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:22:54.956 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T09:22:54.956 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T09:22:54.956 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:22:54.957 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:54.957 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:54.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T09:22:54.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T09:22:54.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T09:22:54.957 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:55.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:55.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:55.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:55.258 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:22:55.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:55.273 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-10T09:22:55.329 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:55.329 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:55.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T09:22:55.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T09:22:55.329 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:55.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:55.447 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T09:22:55.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T09:22:55.448 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:55.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:55.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:55.587 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:55.587 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:55.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-10T09:22:55.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T09:22:55.587 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:55.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:55.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:55.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:55.664 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T09:22:55.693 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:22:55.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:55.693 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T09:22:55.748 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:22:55.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:55.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:22:55.845 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:22:55.845 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:22:55.846 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:22:55.975 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:22:55.975 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:22:55.975 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:22:55.976 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:55.976 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:55.984 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790" 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790:/ 2024-09-10T09:22:55.985 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=b13fea51-e2df-43f6-8889-422976fa1401" will pass to kernel 2024-09-10T09:22:55.986 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T09:22:55.986 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:22:55.986 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:22:55.986 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:22:55.986 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:22:55.988 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:22:55.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:55.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T09:22:56.015 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:56.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:56.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:56.111 INFO:teuthology.orchestra.run.smithi100.stdout:client4469 2024-09-10T09:22:56.111 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:56.111 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:22:56.127 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:56.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:56.222 INFO:teuthology.orchestra.run.smithi100.stdout:client4469 2024-09-10T09:22:56.222 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:56.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:56.279 INFO:teuthology.orchestra.run.smithi100.stdout:client4469 2024-09-10T09:22:56.279 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b13fea51-e2df-43f6-8889-422976fa1401.client4469/status') 2024-09-10T09:22:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:56.337 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.4469 (3)192.168.0.1:0/2030672049 2024-09-10T09:22:56.338 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-09-10T09:22:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-09-10T09:22:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-09-10T09:22:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:69 bytes copied, 2.2184e-05 s, 3.1 MB/s 2024-09-10T09:22:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:56.345 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-10T09:22:56.345 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T09:22:56.345 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T09:22:56.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T09:22:56.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.461+0000 7f174b778640 1 Processor -- start 2024-09-10T09:22:56.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.462+0000 7f174b778640 1 -- start start 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.462+0000 7f174b778640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f174415e940 0x7f17440d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.462+0000 7f174b778640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17440b7170 con 0x7f17440cef90 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.462+0000 7f174b778640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17440b7aa0 con 0x7f174415ed20 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.462+0000 7f174b778640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f17440d3660 con 0x7f174415e940 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f1749d15640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f17440cef90 0x7f17440b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60186/0 (socket says 172.21.15.12:60186) 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f1749d15640 1 -- 172.21.15.12:0/3005639690 learned_addr learned my addr 172.21.15.12:0/3005639690 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f1749514640 1 --2- 172.21.15.12:0/3005639690 >> v2:172.21.15.100:3300/0 conn(0x7f174415e940 0x7f17440d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f173bfff640 1 -- 172.21.15.12:0/3005639690 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548533103 0 0) 0x7f173c001490 con 0x7f17440cef90 2024-09-10T09:22:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f173bfff640 1 -- 172.21.15.12:0/3005639690 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1730003520 con 0x7f17440cef90 2024-09-10T09:22:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f1749514640 1 -- 172.21.15.12:0/3005639690 >> v1:172.21.15.100:6789/0 conn(0x7f174415ed20 legacy=0x7f17440b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f1749514640 1 -- 172.21.15.12:0/3005639690 >> v1:172.21.15.12:6789/0 conn(0x7f17440cef90 legacy=0x7f17440b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f1749514640 1 -- 172.21.15.12:0/3005639690 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17440d3940 con 0x7f174415e940 2024-09-10T09:22:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.463+0000 7f173bfff640 1 -- 172.21.15.12:0/3005639690 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431414479 0 0) 0x7f17440b7aa0 con 0x7f174415ed20 2024-09-10T09:22:56.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.464+0000 7f1749514640 1 --2- 172.21.15.12:0/3005639690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415e940 0x7f17440d1060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17400097a0 tx=0x7f174002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc41a062800d9244 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:56.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.464+0000 7f173bfff640 1 -- 172.21.15.12:0/3005639690 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740037070 con 0x7f174415e940 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.464+0000 7f173bfff640 1 -- 172.21.15.12:0/3005639690 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740032640 con 0x7f174415e940 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.464+0000 7f173bfff640 1 -- 172.21.15.12:0/3005639690 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740032a10 con 0x7f174415e940 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 -- 172.21.15.12:0/3005639690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415e940 msgr2=0x7f17440d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 --2- 172.21.15.12:0/3005639690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415e940 0x7f17440d1060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17400097a0 tx=0x7f174002a2c0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 -- 172.21.15.12:0/3005639690 shutdown_connections 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 --2- 172.21.15.12:0/3005639690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415e940 0x7f17440d1060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 -- 172.21.15.12:0/3005639690 >> 172.21.15.12:0/3005639690 conn(0x7f17440b6240 msgr2=0x7f17440b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 -- 172.21.15.12:0/3005639690 shutdown_connections 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.465+0000 7f174b778640 1 -- 172.21.15.12:0/3005639690 wait complete. 2024-09-10T09:22:56.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.466+0000 7f174b778640 1 Processor -- start 2024-09-10T09:22:56.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.466+0000 7f174b778640 1 -- start start 2024-09-10T09:22:56.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f174b778640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17440cef90 0x7f17440c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:56.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f174b778640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 0x7f17441f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:56.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f174b778640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415ed20 0x7f174415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:56.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f174b778640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17440d3310 con 0x7f174415e940 2024-09-10T09:22:56.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f174b778640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17440d3f00 con 0x7f174415ed20 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f174b778640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f17440d1ef0 con 0x7f17440cef90 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 0x7f17441f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 0x7f17441f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38686/0 (socket says 172.21.15.12:38686) 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 -- 172.21.15.12:0/161904237 learned_addr learned my addr 172.21.15.12:0/161904237 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1749d15640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415ed20 0x7f174415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1749514640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17440cef90 0x7f17440c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 -- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17440cef90 msgr2=0x7f17440c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17440cef90 0x7f17440c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 -- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415ed20 msgr2=0x7f174415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415ed20 0x7f174415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 -- 172.21.15.12:0/161904237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17440c9300 con 0x7f174415e940 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1749514640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17440cef90 0x7f17440c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:56.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1749d15640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415ed20 0x7f174415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.467+0000 7f1748d13640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 0x7f17441f7c60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f173400c3e0 tx=0x7f173400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.468+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734017070 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.468+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17340035f0 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.468+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17440c95e0 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.468+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734003a00 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.468+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17440c9ba0 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.469+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1744068f10 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.469+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f173401a070 con 0x7f174415e940 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.470+0000 7f1739ffb640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f172806be30 0x7f172806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:56.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.470+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f173408a2a0 con 0x7f174415e940 2024-09-10T09:22:56.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.470+0000 7f1749514640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f172806be30 0x7f172806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:56.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.471+0000 7f1749514640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f172806be30 0x7f172806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1740034000 tx=0x7f174002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:56.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.474+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1744068f10 con 0x7f174415e940 2024-09-10T09:22:56.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.686+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17440ba6b0 con 0x7f174415e940 2024-09-10T09:22:56.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.687+0000 7f1739ffb640 1 -- 172.21.15.12:0/161904237 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f1734058c40 con 0x7f174415e940 2024-09-10T09:22:56.688 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T09:22:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.688+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f172806be30 msgr2=0x7f172806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.688+0000 7f174b778640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f172806be30 0x7f172806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1740034000 tx=0x7f174002e000 comp rx=0 tx=0).stop 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.688+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 msgr2=0x7f17441f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.688+0000 7f174b778640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 0x7f17441f7c60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f173400c3e0 tx=0x7f173400c8a0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 shutdown_connections 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f172806be30 0x7f172806e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f174415ed20 0x7f174415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415e940 0x7f17441f7c60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 --2- 172.21.15.12:0/161904237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17440cef90 0x7f17440c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 >> 172.21.15.12:0/161904237 conn(0x7f17440b6240 msgr2=0x7f1744161590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:56.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 shutdown_connections 2024-09-10T09:22:56.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:56.689+0000 7f174b778640 1 -- 172.21.15.12:0/161904237 wait complete. 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T09:22:56.700 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T09:22:56.701 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:22:56.701 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T09:22:56.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:56.701 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T09:22:56.717 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T09:22:56.718 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether b6:ca:b4:6a:81:ad brd ff:ff:ff:ff:ff:ff 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T09:22:56.719 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::28ae:d2ff:fe1b:df05/64 scope link 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether b6:ca:b4:6a:81:ad brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::b4ca:b4ff:fe6a:81ad/64 scope link tentative 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:56.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:56.720 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:22:56.782 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T09:22:56.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:56.783 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T09:22:56.840 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T09:22:56.840 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:22:56.841 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T09:22:56.841 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T09:22:56.841 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:22:56.841 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:56.841 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:56.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T09:22:56.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T09:22:56.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T09:22:56.842 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:56.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:56.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:56.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:56.968 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:22:56.983 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T09:22:56.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:56.984 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-10T09:22:57.040 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T09:22:57.040 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:57.040 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:57.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T09:22:57.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T09:22:57.040 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:57.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:57.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:57.158 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T09:22:57.182 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:57.182 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:57.182 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:57.182 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.182 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:57.182 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.183 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:22:57.183 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether d2:a6:3f:94:91:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T09:22:57.183 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T09:22:57.183 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.183 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d0a6:3fff:fe94:9179/64 scope link tentative 2024-09-10T09:22:57.183 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:57.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:22:57.249 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether d2:a6:3f:94:91:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T09:22:57.250 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T09:22:57.250 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.250 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::d0a6:3fff:fe94:9179/64 scope link tentative 2024-09-10T09:22:57.250 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:22:57.251 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T09:22:57.251 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:57.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:57.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:57.403 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:22:57.403 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:22:57.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2024-09-10T09:22:57.404 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T09:22:57.404 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:22:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:57.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:57.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:57.480 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T09:22:57.495 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T09:22:57.495 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:22:57.495 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T09:22:57.550 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:22:57.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:57.550 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T09:22:57.633 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T09:22:57.633 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-10T09:22:57.633 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:22:57.641 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T09:22:57.641 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-10T09:22:57.642 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:22:57.642 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:57.642 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:57.650 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-10T09:22:57.650 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-10T09:22:57.650 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:22:57.651 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:22:57.651 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:22:57.651 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790" 2024-09-10T09:22:57.651 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790:/ 2024-09-10T09:22:57.651 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=b13fea51-e2df-43f6-8889-422976fa1401" will pass to kernel 2024-09-10T09:22:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-10T09:22:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:22:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:22:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:22:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:22:57.657 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:22:57.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:22:57.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T09:22:57.722 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:57.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:57.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:57.817 INFO:teuthology.orchestra.run.smithi100.stdout:client4605 2024-09-10T09:22:57.818 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:22:57.818 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:22:57.834 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:57.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:57.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:57.930 INFO:teuthology.orchestra.run.smithi100.stdout:client4605 2024-09-10T09:22:57.930 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:22:57.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:22:57.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:57.985 INFO:teuthology.orchestra.run.smithi100.stdout:client4605 2024-09-10T09:22:57.985 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b13fea51-e2df-43f6-8889-422976fa1401.client4605/status') 2024-09-10T09:22:58.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:22:58.044 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.4605 (3)172.21.15.100:0/3775005336 2024-09-10T09:22:58.044 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-09-10T09:22:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-09-10T09:22:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-09-10T09:22:58.044 INFO:teuthology.orchestra.run.smithi100.stderr:71 bytes copied, 2.6175e-05 s, 2.7 MB/s 2024-09-10T09:22:58.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:22:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:22:58.051 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T09:22:58.061 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T09:22:58.196 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2024-09-10T09:22:58.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:22:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.312+0000 7fa86f50a640 1 Processor -- start 2024-09-10T09:22:58.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.312+0000 7fa86f50a640 1 -- start start 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86f50a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8680cf070 0x7fa8680cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86f50a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8680ce740 con 0x7fa86815c180 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86f50a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa868072640 con 0x7fa868073120 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86f50a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa868072920 con 0x7fa8680cf070 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86d2a6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa86815c180 0x7fa8680cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60200/0 (socket says 172.21.15.12:60200) 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86caa5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8680cf070 0x7fa8680cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86d2a6640 1 -- 172.21.15.12:0/4017754826 learned_addr learned my addr 172.21.15.12:0/4017754826 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:58.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86caa5640 1 -- 172.21.15.12:0/4017754826 >> v1:172.21.15.100:6789/0 conn(0x7fa868073120 legacy=0x7fa86806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86caa5640 1 -- 172.21.15.12:0/4017754826 >> v1:172.21.15.12:6789/0 conn(0x7fa86815c180 legacy=0x7fa8680cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa86caa5640 1 -- 172.21.15.12:0/4017754826 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa868072c00 con 0x7fa8680cf070 2024-09-10T09:22:58.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.313+0000 7fa85ffff640 1 -- 172.21.15.12:0/4017754826 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662489339 0 0) 0x7fa8680ce740 con 0x7fa86815c180 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.314+0000 7fa86caa5640 1 --2- 172.21.15.12:0/4017754826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa8680cf4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa8580097a0 tx=0x7fa85802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fec02c41fc566 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.314+0000 7fa85ffff640 1 -- 172.21.15.12:0/4017754826 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858037070 con 0x7fa8680cf070 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.314+0000 7fa85ffff640 1 -- 172.21.15.12:0/4017754826 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa858032440 con 0x7fa8680cf070 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.314+0000 7fa85ffff640 1 -- 172.21.15.12:0/4017754826 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858032810 con 0x7fa8680cf070 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 -- 172.21.15.12:0/4017754826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 msgr2=0x7fa8680cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 --2- 172.21.15.12:0/4017754826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa8680cf4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa8580097a0 tx=0x7fa85802a1a0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 -- 172.21.15.12:0/4017754826 shutdown_connections 2024-09-10T09:22:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 --2- 172.21.15.12:0/4017754826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa8680cf4e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 -- 172.21.15.12:0/4017754826 >> 172.21.15.12:0/4017754826 conn(0x7fa868062cc0 msgr2=0x7fa86806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 -- 172.21.15.12:0/4017754826 shutdown_connections 2024-09-10T09:22:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.315+0000 7fa86f50a640 1 -- 172.21.15.12:0/4017754826 wait complete. 2024-09-10T09:22:58.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.316+0000 7fa86f50a640 1 Processor -- start 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.316+0000 7fa86f50a640 1 -- start start 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86f50a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa868073120 0x7fa8680aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86f50a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa868150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86f50a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa86815c180 0x7fa8681505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86f50a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8680722f0 con 0x7fa8680cf070 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86f50a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8680ced00 con 0x7fa868073120 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86f50a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa86815c560 con 0x7fa86815c180 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa868150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa868150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38716/0 (socket says 172.21.15.12:38716) 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 -- 172.21.15.12:0/1049520613 learned_addr learned my addr 172.21.15.12:0/1049520613 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86d2a6640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa868073120 0x7fa8680aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86daa7640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa86815c180 0x7fa8681505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 -- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa86815c180 msgr2=0x7fa8681505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa86815c180 0x7fa8681505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 -- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa868073120 msgr2=0x7fa8680aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa868073120 0x7fa8680aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.317+0000 7fa86caa5640 1 -- 172.21.15.12:0/1049520613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa868151490 con 0x7fa8680cf070 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.318+0000 7fa86caa5640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa868150090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa858000c00 tx=0x7fa8580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.318+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858037040 con 0x7fa8680cf070 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.318+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa858042070 con 0x7fa8680cf070 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.318+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa868150ea0 con 0x7fa8680cf070 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.318+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858030a70 con 0x7fa8680cf070 2024-09-10T09:22:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.318+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8680b23a0 con 0x7fa8680cf070 2024-09-10T09:22:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.319+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8680cf4e0 con 0x7fa8680cf070 2024-09-10T09:22:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.320+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa858030c10 con 0x7fa8680cf070 2024-09-10T09:22:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.320+0000 7fa85dffb640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa84c06be30 0x7fa84c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.321+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8580ab7c0 con 0x7fa8680cf070 2024-09-10T09:22:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.321+0000 7fa86d2a6640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa84c06be30 0x7fa84c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.321+0000 7fa86d2a6640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa84c06be30 0x7fa84c06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8640012e0 tx=0x7fa864004d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.325+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa858079b10 con 0x7fa8680cf070 2024-09-10T09:22:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.504+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa868151230 con 0x7fa8680cf070 2024-09-10T09:22:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.505+0000 7fa85dffb640 1 -- 172.21.15.12:0/1049520613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fa85807de10 con 0x7fa8680cf070 2024-09-10T09:22:58.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:22:58.506 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa84c06be30 msgr2=0x7fa84c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa84c06be30 0x7fa84c06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8640012e0 tx=0x7fa864004d40 comp rx=0 tx=0).stop 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 msgr2=0x7fa868150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa868150090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa858000c00 tx=0x7fa8580046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 shutdown_connections 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa84c06be30 0x7fa84c06e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa86815c180 0x7fa8681505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8680cf070 0x7fa868150090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 --2- 172.21.15.12:0/1049520613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa868073120 0x7fa8680aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 >> 172.21.15.12:0/1049520613 conn(0x7fa868062cc0 msgr2=0x7fa8680cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 shutdown_connections 2024-09-10T09:22:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.507+0000 7fa86f50a640 1 -- 172.21.15.12:0/1049520613 wait complete. 2024-09-10T09:22:58.519 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T09:22:27.264704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T09:22:36.152109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T09:22:37.271656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T09:22:58.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T09:22:58.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.624+0000 7f15fb578640 1 Processor -- start 2024-09-10T09:22:58.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.624+0000 7f15fb578640 1 -- start start 2024-09-10T09:22:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15fb578640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15f415c5e0 0x7f15f40cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15fb578640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15f4071600 0x7f15f40b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15fb578640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f40cff20 con 0x7f15f40cfa90 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15fb578640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f15f4070b20 con 0x7f15f4071600 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15fb578640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f15f4070e00 con 0x7f15f415c5e0 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15f9b15640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15f4071600 0x7f15f40b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15f9b15640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15f4071600 0x7f15f40b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38732/0 (socket says 172.21.15.12:38732) 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15f9b15640 1 -- 172.21.15.12:0/2757045152 learned_addr learned my addr 172.21.15.12:0/2757045152 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.625+0000 7f15f9314640 1 --2- 172.21.15.12:0/2757045152 >> v2:172.21.15.100:3300/0 conn(0x7f15f415c5e0 0x7f15f40cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.626+0000 7f15f9b15640 1 -- 172.21.15.12:0/2757045152 >> v2:172.21.15.100:3300/0 conn(0x7f15f415c5e0 msgr2=0x7f15f40cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.626+0000 7f15f9b15640 1 --2- 172.21.15.12:0/2757045152 >> v2:172.21.15.100:3300/0 conn(0x7f15f415c5e0 0x7f15f40cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.626+0000 7f15f9b15640 1 -- 172.21.15.12:0/2757045152 >> v1:172.21.15.100:6789/0 conn(0x7f15f40cfa90 legacy=0x7f15f40d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.626+0000 7f15f9b15640 1 -- 172.21.15.12:0/2757045152 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40710e0 con 0x7f15f4071600 2024-09-10T09:22:58.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.626+0000 7f15f3fff640 1 -- 172.21.15.12:0/2757045152 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456090130 0 0) 0x7f15f40cff20 con 0x7f15f40cfa90 2024-09-10T09:22:58.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.626+0000 7f15f9314640 1 --2- 172.21.15.12:0/2757045152 >> v2:172.21.15.100:3300/0 conn(0x7f15f415c5e0 0x7f15f40cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15f9b15640 1 --2- 172.21.15.12:0/2757045152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4071600 0x7f15f40b5a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009e50 tx=0x7f15e402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2e879b28d83679 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15f3fff640 1 -- 172.21.15.12:0/2757045152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4036070 con 0x7f15f4071600 2024-09-10T09:22:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15f3fff640 1 -- 172.21.15.12:0/2757045152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e4031600 con 0x7f15f4071600 2024-09-10T09:22:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15f3fff640 1 -- 172.21.15.12:0/2757045152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e40319d0 con 0x7f15f4071600 2024-09-10T09:22:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 -- 172.21.15.12:0/2757045152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4071600 msgr2=0x7f15f40b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 --2- 172.21.15.12:0/2757045152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4071600 0x7f15f40b5a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009e50 tx=0x7f15e402a6d0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 -- 172.21.15.12:0/2757045152 shutdown_connections 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 --2- 172.21.15.12:0/2757045152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4071600 0x7f15f40b5a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 --2- 172.21.15.12:0/2757045152 >> v2:172.21.15.100:3300/0 conn(0x7f15f415c5e0 0x7f15f40cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 -- 172.21.15.12:0/2757045152 >> 172.21.15.12:0/2757045152 conn(0x7f15f406f310 msgr2=0x7f15f406f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 -- 172.21.15.12:0/2757045152 shutdown_connections 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.627+0000 7f15fb578640 1 -- 172.21.15.12:0/2757045152 wait complete. 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.628+0000 7f15fb578640 1 Processor -- start 2024-09-10T09:22:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 -- start start 2024-09-10T09:22:58.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15f4071600 0x7f15f4155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f415c5e0 0x7f15f415f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 0x7f15f415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40b1f90 con 0x7f15f4159610 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15f40b1e10 con 0x7f15f415c5e0 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15fb578640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f15f40d2ac0 con 0x7f15f4071600 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15f9b15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 0x7f15f415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15f9b15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 0x7f15f415e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38740/0 (socket says 172.21.15.12:38740) 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15f9b15640 1 -- 172.21.15.12:0/2839582228 learned_addr learned my addr 172.21.15.12:0/2839582228 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15f9314640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15f4071600 0x7f15f4155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.629+0000 7f15f8b13640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f415c5e0 0x7f15f415f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f9b15640 1 -- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15f4071600 msgr2=0x7f15f4155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f9b15640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15f4071600 0x7f15f4155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f9b15640 1 -- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f415c5e0 msgr2=0x7f15f415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f9b15640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f415c5e0 0x7f15f415f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f9b15640 1 -- 172.21.15.12:0/2839582228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f4159ba0 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f9b15640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 0x7f15f415e1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009f70 tx=0x7f15e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4036050 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e4042070 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f4159e80 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4009510 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.630+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f415a440 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.631+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f41540e0 con 0x7f15f4159610 2024-09-10T09:22:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.632+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15e4007bf0 con 0x7f15f4159610 2024-09-10T09:22:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.632+0000 7f15f1ffb640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15e006be30 0x7f15e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.632+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15e40abb50 con 0x7f15f4159610 2024-09-10T09:22:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.633+0000 7f15f9314640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15e006be30 0x7f15e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.633+0000 7f15f9314640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15e006be30 0x7f15e006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009560 tx=0x7f15ec009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.637+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15e4079eb0 con 0x7f15f4159610 2024-09-10T09:22:58.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.814+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15f415a9a0 con 0x7f15f4159610 2024-09-10T09:22:58.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.814+0000 7f15f1ffb640 1 -- 172.21.15.12:0/2839582228 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f15e407e1b0 con 0x7f15f4159610 2024-09-10T09:22:58.815 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15e006be30 msgr2=0x7f15e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15e006be30 0x7f15e006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009560 tx=0x7f15ec009190 comp rx=0 tx=0).stop 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 msgr2=0x7f15f415e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 0x7f15f415e1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009f70 tx=0x7f15e4004a40 comp rx=0 tx=0).stop 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 shutdown_connections 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15e006be30 0x7f15e006e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15f4159610 0x7f15f415e1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f415c5e0 0x7f15f415f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 --2- 172.21.15.12:0/2839582228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15f4071600 0x7f15f4155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 >> 172.21.15.12:0/2839582228 conn(0x7f15f406f310 msgr2=0x7f15f40b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 shutdown_connections 2024-09-10T09:22:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.816+0000 7f15fb578640 1 -- 172.21.15.12:0/2839582228 wait complete. 2024-09-10T09:22:58.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T09:22:58.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.933+0000 7f215312c640 1 Processor -- start 2024-09-10T09:22:58.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.933+0000 7f215312c640 1 -- start start 2024-09-10T09:22:58.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f215312c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 0x7f214c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f215312c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 0x7f214c0d31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f215312c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214c0cfb90 con 0x7f214c0b3430 2024-09-10T09:22:58.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f215312c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f214c0d22c0 con 0x7f214c0d2d10 2024-09-10T09:22:58.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f215312c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f214c06c810 con 0x7f214c0cf750 2024-09-10T09:22:58.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f2143fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 0x7f214c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f21516c9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 0x7f214c0d31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f2150ec8640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f214c0b3430 0x7f214c0b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:38858/0 (socket says 172.21.15.12:38858) 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f2143fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 0x7f214c06c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:57626/0 (socket says 172.21.15.12:57626) 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f2150ec8640 1 -- 172.21.15.12:0/1967818919 learned_addr learned my addr 172.21.15.12:0/1967818919 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.934+0000 7f21516c9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 0x7f214c0d31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:59114/0 (socket says 172.21.15.12:59114) 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f2143fff640 1 -- 172.21.15.12:0/1967818919 >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 msgr2=0x7f214c0d31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f2143fff640 1 --2- 172.21.15.12:0/1967818919 >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 0x7f214c0d31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f2143fff640 1 -- 172.21.15.12:0/1967818919 >> v1:172.21.15.100:6789/0 conn(0x7f214c0b3430 legacy=0x7f214c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f2143fff640 1 -- 172.21.15.12:0/1967818919 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c15e9d0 con 0x7f214c0cf750 2024-09-10T09:22:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f21516c9640 1 --2- 172.21.15.12:0/1967818919 >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 0x7f214c0d31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f2143fff640 1 --2- 172.21.15.12:0/1967818919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 0x7f214c06c2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f213c0097a0 tx=0x7f213c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08c8db5752b306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.935+0000 7f21437fe640 1 -- 172.21.15.12:0/1967818919 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c037070 con 0x7f214c0cf750 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f21437fe640 1 -- 172.21.15.12:0/1967818919 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c02ae50 con 0x7f214c0cf750 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f21437fe640 1 -- 172.21.15.12:0/1967818919 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c032660 con 0x7f214c0cf750 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 -- 172.21.15.12:0/1967818919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 msgr2=0x7f214c06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 --2- 172.21.15.12:0/1967818919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 0x7f214c06c2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f213c0097a0 tx=0x7f213c02a100 comp rx=0 tx=0).stop 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 -- 172.21.15.12:0/1967818919 shutdown_connections 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 --2- 172.21.15.12:0/1967818919 >> v2:172.21.15.100:3300/0 conn(0x7f214c0d2d10 0x7f214c0d31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 --2- 172.21.15.12:0/1967818919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0cf750 0x7f214c06c2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 -- 172.21.15.12:0/1967818919 >> 172.21.15.12:0/1967818919 conn(0x7f214c0d4b10 msgr2=0x7f214c0d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 -- 172.21.15.12:0/1967818919 shutdown_connections 2024-09-10T09:22:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.936+0000 7f215312c640 1 -- 172.21.15.12:0/1967818919 wait complete. 2024-09-10T09:22:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.937+0000 7f215312c640 1 Processor -- start 2024-09-10T09:22:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.937+0000 7f215312c640 1 -- start start 2024-09-10T09:22:58.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f215312c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f214c0b3430 0x7f214c1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f215312c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 0x7f214c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f215312c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0d2d10 0x7f214c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f215312c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f214c0d2510 con 0x7f214c0cf750 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f215312c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f214c06cd50 con 0x7f214c0b3430 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f215312c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f214c0d27f0 con 0x7f214c0d2d10 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f2143fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 0x7f214c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f2143fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 0x7f214c15ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38752/0 (socket says 172.21.15.12:38752) 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f2143fff640 1 -- 172.21.15.12:0/3820040679 learned_addr learned my addr 172.21.15.12:0/3820040679 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f21516c9640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0d2d10 0x7f214c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.938+0000 7f2150ec8640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f214c0b3430 0x7f214c1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f2143fff640 1 -- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0d2d10 msgr2=0x7f214c0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f2143fff640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0d2d10 0x7f214c0cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f2143fff640 1 -- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f214c0b3430 msgr2=0x7f214c1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f2143fff640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f214c0b3430 0x7f214c1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f2143fff640 1 -- 172.21.15.12:0/3820040679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c0cc780 con 0x7f214c0cf750 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f2143fff640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 0x7f214c15ec00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f213c000c00 tx=0x7f213c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c042070 con 0x7f214c0cf750 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c03e670 con 0x7f214c0cf750 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c15f290 con 0x7f214c0cf750 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c037040 con 0x7f214c0cf750 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.939+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c15f850 con 0x7f214c0cf750 2024-09-10T09:22:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.940+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c15fa90 con 0x7f214c0cf750 2024-09-10T09:22:58.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.941+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f213c045070 con 0x7f214c0cf750 2024-09-10T09:22:58.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.941+0000 7f21417fa640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f213806be60 0x7f213806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:58.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.941+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f213c0ab2f0 con 0x7f214c0cf750 2024-09-10T09:22:58.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.942+0000 7f2150ec8640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f213806be60 0x7f213806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:58.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.942+0000 7f2150ec8640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f213806be60 0x7f213806e320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2148007fd0 tx=0x7f2148007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:58.946+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f213c079650 con 0x7f214c0cf750 2024-09-10T09:22:59.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.122+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f214c0c9390 con 0x7f214c0cf750 2024-09-10T09:22:59.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.122+0000 7f21417fa640 1 -- 172.21.15.12:0/3820040679 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f213c07d950 con 0x7f214c0cf750 2024-09-10T09:22:59.123 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-10T09:22:59.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f213806be60 msgr2=0x7f213806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f213806be60 0x7f213806e320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2148007fd0 tx=0x7f2148007e80 comp rx=0 tx=0).stop 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 msgr2=0x7f214c15ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 0x7f214c15ec00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f213c000c00 tx=0x7f213c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 shutdown_connections 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f213806be60 0x7f213806e320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f214c0d2d10 0x7f214c0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0cf750 0x7f214c15ec00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 --2- 172.21.15.12:0/3820040679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f214c0b3430 0x7f214c1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 >> 172.21.15.12:0/3820040679 conn(0x7f214c0d4b10 msgr2=0x7f214c0ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 shutdown_connections 2024-09-10T09:22:59.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.124+0000 7f215312c640 1 -- 172.21.15.12:0/3820040679 wait complete. 2024-09-10T09:22:59.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T09:22:59.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.241+0000 7f39fce82640 1 Processor -- start 2024-09-10T09:22:59.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.241+0000 7f39fce82640 1 -- start start 2024-09-10T09:22:59.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39fce82640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39f8071960 0x7f39f80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39fce82640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f815f370 con 0x7f39f80714f0 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39fce82640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f815f650 con 0x7f39f80d1260 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39fce82640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f39f815fef0 con 0x7f39f8071960 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39f6d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39f8071960 0x7f39f80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39f5d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f39f80714f0 0x7f39f80b6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60216/0 (socket says 172.21.15.12:60216) 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39f6d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39f8071960 0x7f39f80735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38762/0 (socket says 172.21.15.12:38762) 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.242+0000 7f39f5d9b640 1 -- 172.21.15.12:0/1612296635 learned_addr learned my addr 172.21.15.12:0/1612296635 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.243+0000 7f39f6d9d640 1 -- 172.21.15.12:0/1612296635 >> v1:172.21.15.100:6789/0 conn(0x7f39f80d1260 legacy=0x7f39f806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.243+0000 7f39f559a640 1 -- 172.21.15.12:0/1612296635 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086980106 0 0) 0x7f39f815f370 con 0x7f39f80714f0 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.243+0000 7f39f6d9d640 1 -- 172.21.15.12:0/1612296635 >> v1:172.21.15.12:6789/0 conn(0x7f39f80714f0 legacy=0x7f39f80b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.243+0000 7f39f6d9d640 1 -- 172.21.15.12:0/1612296635 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f815f930 con 0x7f39f8071960 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.243+0000 7f39f6d9d640 1 --2- 172.21.15.12:0/1612296635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f8071960 0x7f39f80735c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097a0 tx=0x7f39f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a26269214ee88b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39f559a640 1 -- 172.21.15.12:0/1612296635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037070 con 0x7f39f8071960 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39f559a640 1 -- 172.21.15.12:0/1612296635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0032440 con 0x7f39f8071960 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39f559a640 1 -- 172.21.15.12:0/1612296635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0032810 con 0x7f39f8071960 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 -- 172.21.15.12:0/1612296635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f8071960 msgr2=0x7f39f80735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 --2- 172.21.15.12:0/1612296635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f8071960 0x7f39f80735c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097a0 tx=0x7f39f002a1a0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 -- 172.21.15.12:0/1612296635 shutdown_connections 2024-09-10T09:22:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 --2- 172.21.15.12:0/1612296635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f8071960 0x7f39f80735c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 -- 172.21.15.12:0/1612296635 >> 172.21.15.12:0/1612296635 conn(0x7f39f806f370 msgr2=0x7f39f806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 -- 172.21.15.12:0/1612296635 shutdown_connections 2024-09-10T09:22:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.244+0000 7f39fce82640 1 -- 172.21.15.12:0/1612296635 wait complete. 2024-09-10T09:22:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 Processor -- start 2024-09-10T09:22:59.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 -- start start 2024-09-10T09:22:59.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 0x7f39f814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39f8071960 0x7f39f80b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f39f80d1260 0x7f39f815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f39f80d17c0 con 0x7f39f80714f0 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f39f80d1640 con 0x7f39f8071960 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39fce82640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f39f815ef30 con 0x7f39f80d1260 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39f659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 0x7f39f814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.246+0000 7f39f659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 0x7f39f814a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38766/0 (socket says 172.21.15.12:38766) 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 -- 172.21.15.12:0/3452160637 learned_addr learned my addr 172.21.15.12:0/3452160637 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f5d9b640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39f8071960 0x7f39f80b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f6d9d640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f39f80d1260 0x7f39f815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 -- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f39f80d1260 msgr2=0x7f39f815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f39f80d1260 0x7f39f815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 -- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39f8071960 msgr2=0x7f39f80b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39f8071960 0x7f39f80b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 -- 172.21.15.12:0/3452160637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f80b2f00 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39f659c640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 0x7f39f814a790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f39e800c730 tx=0x7f39e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8016020 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e8006d50 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f80b31a0 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8003bb0 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.247+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f80b3760 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.248+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f806ccb0 con 0x7f39f80714f0 2024-09-10T09:22:59.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.249+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39e800a850 con 0x7f39f80714f0 2024-09-10T09:22:59.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.249+0000 7f39eeffd640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f39d806be30 0x7f39d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.249+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39e808a900 con 0x7f39f80714f0 2024-09-10T09:22:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.250+0000 7f39f5d9b640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f39d806be30 0x7f39d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.250+0000 7f39f5d9b640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f39d806be30 0x7f39d806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39e0007f70 tx=0x7f39e0007f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:59.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.254+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39e8020020 con 0x7f39f80714f0 2024-09-10T09:22:59.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.430+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f39f8069160 con 0x7f39f80714f0 2024-09-10T09:22:59.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.430+0000 7f39eeffd640 1 -- 172.21.15.12:0/3452160637 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f39e8058cf0 con 0x7f39f80714f0 2024-09-10T09:22:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-10T09:22:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f39d806be30 msgr2=0x7f39d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f39d806be30 0x7f39d806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39e0007f70 tx=0x7f39e0007f00 comp rx=0 tx=0).stop 2024-09-10T09:22:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 msgr2=0x7f39f814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 0x7f39f814a790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f39e800c730 tx=0x7f39e800cbf0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 shutdown_connections 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f39d806be30 0x7f39d806e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f39f80d1260 0x7f39f815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39f8071960 0x7f39f80b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 --2- 172.21.15.12:0/3452160637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f80714f0 0x7f39f814a790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 >> 172.21.15.12:0/3452160637 conn(0x7f39f806f370 msgr2=0x7f39f80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 shutdown_connections 2024-09-10T09:22:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.432+0000 7f39fce82640 1 -- 172.21.15.12:0/3452160637 wait complete. 2024-09-10T09:22:59.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-10T09:22:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.546+0000 7facf11cf640 1 Processor -- start 2024-09-10T09:22:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.546+0000 7facf11cf640 1 -- start start 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.547+0000 7facf11cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 0x7facec071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.547+0000 7facf11cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec071880 con 0x7facec06ccb0 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.547+0000 7facf11cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec0741c0 con 0x7facec0b5600 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.547+0000 7facf11cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7facec06e680 con 0x7facec15e7b0 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.547+0000 7faceb59e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7facec06ccb0 0x7facec06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60228/0 (socket says 172.21.15.12:60228) 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7faceb59e640 1 -- 172.21.15.12:0/1702154684 learned_addr learned my addr 172.21.15.12:0/1702154684 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7facead9d640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 0x7facec071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854745980 0 0) 0x7face4001110 con 0x7facec06ccb0 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facd8003520 con 0x7facec06ccb0 2024-09-10T09:22:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3385862225 0 0) 0x7facd8003520 con 0x7facec06ccb0 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 msgr2=0x7facec071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 0x7facec071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 >> v1:172.21.15.100:6789/0 conn(0x7facec0b5600 legacy=0x7facec073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec06e8d0 con 0x7facec06ccb0 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7face4001840 con 0x7facec06ccb0 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 >> v1:172.21.15.12:6789/0 conn(0x7facec06ccb0 legacy=0x7facec06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 0x7facd80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd8004d40 0x7facd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7facec06e680 con 0x7facd8003f60 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7facd800bb50 con 0x7facd8004d40 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7facd800bd50 con 0x7facec15e7b0 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7facea59c640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7facead9d640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 0x7facd80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.548+0000 7faceb59e640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd8004d40 0x7facd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7facea59c640 1 -- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 msgr2=0x7facd80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7facea59c640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec15e7b0 0x7facd80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7facea59c640 1 -- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd8004d40 msgr2=0x7facd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:22:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7facea59c640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd8004d40 0x7facd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7facea59c640 1 -- 172.21.15.12:0/1702154684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8003520 con 0x7facd8003f60 2024-09-10T09:22:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7facea59c640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facd8004800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7facd4001720 tx=0x7facd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303e7fa7ed649359 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.549+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4001370 con 0x7facd8003f60 2024-09-10T09:22:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd40052d0 con 0x7facd8003f60 2024-09-10T09:22:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7face9d9b640 1 -- 172.21.15.12:0/1702154684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd402abc0 con 0x7facd8003f60 2024-09-10T09:22:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7facf11cf640 1 -- 172.21.15.12:0/1702154684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 msgr2=0x7facd8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7facf11cf640 1 --2- 172.21.15.12:0/1702154684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facd8004800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7facd4001720 tx=0x7facd8005830 comp rx=0 tx=0).stop 2024-09-10T09:22:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7faceb59e640 1 -- 172.21.15.12:0/1702154684 reap_dead start 2024-09-10T09:22:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7facf11cf640 1 -- 172.21.15.12:0/1702154684 shutdown_connections 2024-09-10T09:22:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7facf11cf640 1 -- 172.21.15.12:0/1702154684 >> 172.21.15.12:0/1702154684 conn(0x7facec0b4300 msgr2=0x7facec0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:22:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7facf11cf640 1 -- 172.21.15.12:0/1702154684 shutdown_connections 2024-09-10T09:22:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.550+0000 7facf11cf640 1 -- 172.21.15.12:0/1702154684 wait complete. 2024-09-10T09:22:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.551+0000 7facf11cf640 1 Processor -- start 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 -- start start 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facec1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facec0d1b90 0x7facec0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec0cc180 0x7facec0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7facec073590 con 0x7facd8003f60 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7facec0732b0 con 0x7facec0d1b90 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facf11cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7facec071340 con 0x7facec0cc180 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facead9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facec1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facead9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facec1f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38778/0 (socket says 172.21.15.12:38778) 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.552+0000 7facead9d640 1 -- 172.21.15.12:0/253288022 learned_addr learned my addr 172.21.15.12:0/253288022 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7faceb59e640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec0cc180 0x7facec0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facea59c640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facec0d1b90 0x7facec0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facead9d640 1 -- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec0cc180 msgr2=0x7facec0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facead9d640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec0cc180 0x7facec0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facead9d640 1 -- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facec0d1b90 msgr2=0x7facec0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facead9d640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facec0d1b90 0x7facec0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facead9d640 1 -- 172.21.15.12:0/253288022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec0cde10 con 0x7facd8003f60 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7faceb59e640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec0cc180 0x7facec0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facead9d640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facec1f5880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7facdc011e30 tx=0x7facdc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc015630 con 0x7facd8003f60 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facdc0157d0 con 0x7facd8003f60 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc015ba0 con 0x7facd8003f60 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec0ce0f0 con 0x7facd8003f60 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.553+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec0d2010 con 0x7facd8003f60 2024-09-10T09:22:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.554+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec06d120 con 0x7facd8003f60 2024-09-10T09:22:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.555+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facdc01d400 con 0x7facd8003f60 2024-09-10T09:22:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.555+0000 7face37fe640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faccc06be60 0x7faccc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:22:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.555+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7facdc08bf60 con 0x7facd8003f60 2024-09-10T09:22:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.555+0000 7facea59c640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faccc06be60 0x7faccc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:22:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.556+0000 7facea59c640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faccc06be60 0x7faccc06e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facd4001720 tx=0x7facd402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:22:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.560+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facdc019030 con 0x7facd8003f60 2024-09-10T09:22:59.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:22:59.806+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7facec0b1a90 con 0x7facd8003f60 2024-09-10T09:23:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.015+0000 7face37fe640 1 -- 172.21.15.12:0/253288022 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v41) ==== 170+0+0 (secure 0 0 0) 0x7facdc010040 con 0x7facd8003f60 2024-09-10T09:23:00.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faccc06be60 msgr2=0x7faccc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faccc06be60 0x7faccc06e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facd4001720 tx=0x7facd402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:00.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 msgr2=0x7facec1f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facec1f5880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7facdc011e30 tx=0x7facdc00f580 comp rx=0 tx=0).stop 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 shutdown_connections 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faccc06be60 0x7faccc06e320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facec0cc180 0x7facec0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facec0d1b90 0x7facec0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 --2- 172.21.15.12:0/253288022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facd8003f60 0x7facec1f5880 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 >> 172.21.15.12:0/253288022 conn(0x7facec0b4300 msgr2=0x7facec161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 shutdown_connections 2024-09-10T09:23:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.017+0000 7facf11cf640 1 -- 172.21.15.12:0/253288022 wait complete. 2024-09-10T09:23:00.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T09:23:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.138+0000 7fd99f9d6640 1 Processor -- start 2024-09-10T09:23:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.139+0000 7fd99f9d6640 1 -- start start 2024-09-10T09:23:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.139+0000 7fd99f9d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.139+0000 7fd99f9d6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd99806d080 0x7fd99815b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.139+0000 7fd99f9d6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd998071de0 con 0x7fd99815b090 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.139+0000 7fd99f9d6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd9980720c0 con 0x7fd99806d080 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.139+0000 7fd99f9d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd9980723a0 con 0x7fd99806ea00 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd99806d080 0x7fd99815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd99806d080 0x7fd99815b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38794/0 (socket says 172.21.15.12:38794) 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 -- 172.21.15.12:0/924252332 learned_addr learned my addr 172.21.15.12:0/924252332 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99cf71640 1 --2- 172.21.15.12:0/924252332 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 -- 172.21.15.12:0/924252332 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 msgr2=0x7fd9980b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 --2- 172.21.15.12:0/924252332 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 -- 172.21.15.12:0/924252332 >> v1:172.21.15.100:6789/0 conn(0x7fd99815b090 legacy=0x7fd9980715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:00.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.140+0000 7fd99df73640 1 -- 172.21.15.12:0/924252332 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd998072680 con 0x7fd99806d080 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99df73640 1 --2- 172.21.15.12:0/924252332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99806d080 0x7fd99815b470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd988009e50 tx=0x7fd98802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc56e9ac2ab643de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd997fff640 1 -- 172.21.15.12:0/924252332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988036070 con 0x7fd99806d080 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd997fff640 1 -- 172.21.15.12:0/924252332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988031600 con 0x7fd99806d080 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd997fff640 1 -- 172.21.15.12:0/924252332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880319d0 con 0x7fd99806d080 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 -- 172.21.15.12:0/924252332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99806d080 msgr2=0x7fd99815b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/924252332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99806d080 0x7fd99815b470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd988009e50 tx=0x7fd98802a6c0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 -- 172.21.15.12:0/924252332 shutdown_connections 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/924252332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99806d080 0x7fd99815b470 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/924252332 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 -- 172.21.15.12:0/924252332 >> 172.21.15.12:0/924252332 conn(0x7fd99806bba0 msgr2=0x7fd99806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:00.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 -- 172.21.15.12:0/924252332 shutdown_connections 2024-09-10T09:23:00.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.141+0000 7fd99f9d6640 1 -- 172.21.15.12:0/924252332 wait complete. 2024-09-10T09:23:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 Processor -- start 2024-09-10T09:23:00.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 -- start start 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd99806d080 0x7fd998146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 0x7fd9980aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd99806d670 con 0x7fd99815b090 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd99806d4f0 con 0x7fd99806d080 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99f9d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd99815b9b0 con 0x7fd99806ea00 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99df73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 0x7fd9980aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.143+0000 7fd99df73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 0x7fd9980aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38804/0 (socket says 172.21.15.12:38804) 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 -- 172.21.15.12:0/1238537331 learned_addr learned my addr 172.21.15.12:0/1238537331 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99cf71640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99d772640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd99806d080 0x7fd998146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 -- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 msgr2=0x7fd9980ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 -- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd99806d080 msgr2=0x7fd998146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd99806d080 0x7fd998146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 -- 172.21.15.12:0/1238537331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99814f0c0 con 0x7fd99815b090 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99df73640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 0x7fd9980aee20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd988009e50 tx=0x7fd988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988036050 con 0x7fd99815b090 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988042070 con 0x7fd99815b090 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99814f3a0 con 0x7fd99815b090 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988009510 con 0x7fd99815b090 2024-09-10T09:23:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.144+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99814f960 con 0x7fd99815b090 2024-09-10T09:23:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.145+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99815bde0 con 0x7fd99815b090 2024-09-10T09:23:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.146+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd988007bd0 con 0x7fd99815b090 2024-09-10T09:23:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.146+0000 7fd995ffb640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd98406be30 0x7fd98406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.147+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd9880abd10 con 0x7fd99815b090 2024-09-10T09:23:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.147+0000 7fd99d772640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd98406be30 0x7fd98406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.147+0000 7fd99d772640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd98406be30 0x7fd98406e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd990006fd0 tx=0x7fd990009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.151+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9880b1020 con 0x7fd99815b090 2024-09-10T09:23:00.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.326+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd99806dc90 con 0x7fd99815b090 2024-09-10T09:23:00.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.329+0000 7fd995ffb640 1 -- 172.21.15.12:0/1238537331 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd988079fd0 con 0x7fd99815b090 2024-09-10T09:23:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd98406be30 msgr2=0x7fd98406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd98406be30 0x7fd98406e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd990006fd0 tx=0x7fd990009060 comp rx=0 tx=0).stop 2024-09-10T09:23:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 msgr2=0x7fd9980aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 0x7fd9980aee20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd988009e50 tx=0x7fd988004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 shutdown_connections 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd98406be30 0x7fd98406e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd99815b090 0x7fd9980aee20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd99806ea00 0x7fd9980ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 --2- 172.21.15.12:0/1238537331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd99806d080 0x7fd998146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 >> 172.21.15.12:0/1238537331 conn(0x7fd99806bba0 msgr2=0x7fd99806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 shutdown_connections 2024-09-10T09:23:00.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.331+0000 7fd99f9d6640 1 -- 172.21.15.12:0/1238537331 wait complete. 2024-09-10T09:23:00.343 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T09:23:00.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T09:23:00.398 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T09:23:00.440 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T09:23:00.440 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:00.440 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:00.456 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:00.456 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:00.513 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:00.513 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:00.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T09:23:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.712+0000 7f325be5c640 1 Processor -- start 2024-09-10T09:23:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.712+0000 7f325be5c640 1 -- start start 2024-09-10T09:23:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325be5c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540b68d0 0x7f32540cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325be5c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32540ced90 0x7f32540b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325be5c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32540d26f0 con 0x7f325415eac0 2024-09-10T09:23:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325be5c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f32540d29d0 con 0x7f32540ced90 2024-09-10T09:23:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325be5c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f32540d2cb0 con 0x7f32540b68d0 2024-09-10T09:23:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325a3f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32540ced90 0x7f32540b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f3259bf8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f325415eac0 0x7f32540b61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60230/0 (socket says 172.21.15.12:60230) 2024-09-10T09:23:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f3259bf8640 1 -- 172.21.15.12:0/455729938 learned_addr learned my addr 172.21.15.12:0/455729938 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f32593f7640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540b68d0 0x7f32540cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325a3f9640 1 -- 172.21.15.12:0/455729938 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540b68d0 msgr2=0x7f32540cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325a3f9640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540b68d0 0x7f32540cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325a3f9640 1 -- 172.21.15.12:0/455729938 >> v1:172.21.15.12:6789/0 conn(0x7f325415eac0 legacy=0x7f32540b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f325a3f9640 1 -- 172.21.15.12:0/455729938 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540d2f90 con 0x7f32540ced90 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.713+0000 7f32593f7640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540b68d0 0x7f32540cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.714+0000 7f325a3f9640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32540ced90 0x7f32540b79b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f324c009d90 tx=0x7f324c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3be561adb4e9cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.714+0000 7f3258bf6640 1 -- 172.21.15.12:0/455729938 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c007740 con 0x7f32540ced90 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.714+0000 7f3258bf6640 1 -- 172.21.15.12:0/455729938 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c0078e0 con 0x7f32540ced90 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.714+0000 7f3258bf6640 1 -- 172.21.15.12:0/455729938 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c007cb0 con 0x7f32540ced90 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.714+0000 7f325be5c640 1 -- 172.21.15.12:0/455729938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32540ced90 msgr2=0x7f32540b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.714+0000 7f325be5c640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32540ced90 0x7f32540b79b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f324c009d90 tx=0x7f324c02a660 comp rx=0 tx=0).stop 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.715+0000 7f325be5c640 1 -- 172.21.15.12:0/455729938 shutdown_connections 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.715+0000 7f325be5c640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32540ced90 0x7f32540b79b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.715+0000 7f325be5c640 1 --2- 172.21.15.12:0/455729938 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540b68d0 0x7f32540cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.715+0000 7f325be5c640 1 -- 172.21.15.12:0/455729938 >> 172.21.15.12:0/455729938 conn(0x7f32540d11c0 msgr2=0x7f32540d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:00.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.715+0000 7f325be5c640 1 -- 172.21.15.12:0/455729938 shutdown_connections 2024-09-10T09:23:00.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.715+0000 7f325be5c640 1 -- 172.21.15.12:0/455729938 wait complete. 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.716+0000 7f325be5c640 1 Processor -- start 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.716+0000 7f325be5c640 1 -- start start 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325be5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32540b68d0 0x7f32540c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325be5c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540ced90 0x7f32540b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325be5c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 0x7f3254154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325be5c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32540d2490 con 0x7f325415eac0 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325be5c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32540d2310 con 0x7f32540b68d0 2024-09-10T09:23:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325be5c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f32540d3790 con 0x7f32540ced90 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 0x7f3254154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 0x7f3254154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38822/0 (socket says 172.21.15.12:38822) 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 -- 172.21.15.12:0/124420926 learned_addr learned my addr 172.21.15.12:0/124420926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f32593f7640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540ced90 0x7f32540b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f3259bf8640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32540b68d0 0x7f32540c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 -- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540ced90 msgr2=0x7f32540b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540ced90 0x7f32540b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 -- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32540b68d0 msgr2=0x7f32540c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32540b68d0 0x7f32540c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 -- 172.21.15.12:0/124420926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540c9730 con 0x7f325415eac0 2024-09-10T09:23:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f32593f7640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540ced90 0x7f32540b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f3259bf8640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32540b68d0 0x7f32540c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f325a3f9640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 0x7f3254154520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f324c009eb0 tx=0x7f324c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c040070 con 0x7f325415eac0 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c031c90 con 0x7f325415eac0 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.717+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c045680 con 0x7f325415eac0 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.718+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3254160410 con 0x7f325415eac0 2024-09-10T09:23:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.718+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32541609d0 con 0x7f325415eac0 2024-09-10T09:23:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.719+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32540cfc80 con 0x7f325415eac0 2024-09-10T09:23:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.719+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f324c039040 con 0x7f325415eac0 2024-09-10T09:23:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.719+0000 7f324a7fc640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f323806be30 0x7f323806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.720+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f324c0ac8e0 con 0x7f325415eac0 2024-09-10T09:23:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.720+0000 7f3259bf8640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f323806be30 0x7f323806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.720+0000 7f3259bf8640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f323806be30 0x7f323806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3250000f60 tx=0x7f3250009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.724+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f324c07b350 con 0x7f325415eac0 2024-09-10T09:23:00.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.910+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f32540ba450 con 0x7f325415eac0 2024-09-10T09:23:00.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.911+0000 7f324a7fc640 1 -- 172.21.15.12:0/124420926 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f324c07ac50 con 0x7f325415eac0 2024-09-10T09:23:00.912 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-10T09:23:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f323806be30 msgr2=0x7f323806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f323806be30 0x7f323806e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3250000f60 tx=0x7f3250009040 comp rx=0 tx=0).stop 2024-09-10T09:23:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 msgr2=0x7f3254154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 0x7f3254154520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f324c009eb0 tx=0x7f324c004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 shutdown_connections 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f323806be30 0x7f323806e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325415eac0 0x7f3254154520 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f32540ced90 0x7f32540b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 --2- 172.21.15.12:0/124420926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32540b68d0 0x7f32540c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 >> 172.21.15.12:0/124420926 conn(0x7f32540d11c0 msgr2=0x7f32540b9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 shutdown_connections 2024-09-10T09:23:00.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:00.913+0000 7f325be5c640 1 -- 172.21.15.12:0/124420926 wait complete. 2024-09-10T09:23:00.925 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T09:23:00.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:00.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-10T09:23:00.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:23:00.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:00.952 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T09:23:01.018 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:01.018 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:01.037 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:01.038 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:01.097 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:01.098 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:01.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T09:23:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.263+0000 7f43ab2af640 1 Processor -- start 2024-09-10T09:23:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.263+0000 7f43ab2af640 1 -- start start 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43ab2af640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43a415eac0 0x7f43a40cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43ab2af640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a40d26f0 con 0x7f43a40b68d0 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43ab2af640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a40d29d0 con 0x7f43a40ced90 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43ab2af640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f43a40d2cb0 con 0x7f43a415eac0 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43a904b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43a415eac0 0x7f43a40cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43a984c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f43a40b68d0 0x7f43a40d3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60234/0 (socket says 172.21.15.12:60234) 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43a984c640 1 -- 172.21.15.12:0/390101069 learned_addr learned my addr 172.21.15.12:0/390101069 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43a904b640 1 -- 172.21.15.12:0/390101069 >> v1:172.21.15.100:6789/0 conn(0x7f43a40ced90 legacy=0x7f43a40b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43a904b640 1 -- 172.21.15.12:0/390101069 >> v1:172.21.15.12:6789/0 conn(0x7f43a40b68d0 legacy=0x7f43a40d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f439bfff640 1 -- 172.21.15.12:0/390101069 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258572854 0 0) 0x7f43a40d26f0 con 0x7f43a40b68d0 2024-09-10T09:23:01.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.264+0000 7f43a904b640 1 -- 172.21.15.12:0/390101069 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a40d2f90 con 0x7f43a415eac0 2024-09-10T09:23:01.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.265+0000 7f43a904b640 1 --2- 172.21.15.12:0/390101069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a415eac0 0x7f43a40cfc80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43a00097a0 tx=0x7f43a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15470815ffabefd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:01.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.265+0000 7f439bfff640 1 -- 172.21.15.12:0/390101069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0037070 con 0x7f43a415eac0 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.265+0000 7f439bfff640 1 -- 172.21.15.12:0/390101069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a0032440 con 0x7f43a415eac0 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.265+0000 7f439bfff640 1 -- 172.21.15.12:0/390101069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0032810 con 0x7f43a415eac0 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 -- 172.21.15.12:0/390101069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a415eac0 msgr2=0x7f43a40cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 --2- 172.21.15.12:0/390101069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a415eac0 0x7f43a40cfc80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43a00097a0 tx=0x7f43a002a1e0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 -- 172.21.15.12:0/390101069 shutdown_connections 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 --2- 172.21.15.12:0/390101069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a415eac0 0x7f43a40cfc80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 -- 172.21.15.12:0/390101069 >> 172.21.15.12:0/390101069 conn(0x7f43a40d11c0 msgr2=0x7f43a40d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 -- 172.21.15.12:0/390101069 shutdown_connections 2024-09-10T09:23:01.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.266+0000 7f43ab2af640 1 -- 172.21.15.12:0/390101069 wait complete. 2024-09-10T09:23:01.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.267+0000 7f43ab2af640 1 Processor -- start 2024-09-10T09:23:01.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.267+0000 7f43ab2af640 1 -- start start 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43ab2af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a40b68d0 0x7f43a41548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43ab2af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 0x7f43a40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43ab2af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f43a415eac0 0x7f43a40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43ab2af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43a40d2490 con 0x7f43a40ced90 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43ab2af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43a40d2310 con 0x7f43a40b68d0 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43ab2af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f43a40b79b0 con 0x7f43a415eac0 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 0x7f43a40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 0x7f43a40ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38844/0 (socket says 172.21.15.12:38844) 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 -- 172.21.15.12:0/375308357 learned_addr learned my addr 172.21.15.12:0/375308357 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a904b640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a40b68d0 0x7f43a41548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a984c640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f43a415eac0 0x7f43a40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 -- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f43a415eac0 msgr2=0x7f43a40b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f43a415eac0 0x7f43a40b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 -- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a40b68d0 msgr2=0x7f43a41548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a40b68d0 0x7f43a41548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 -- 172.21.15.12:0/375308357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a40ceb20 con 0x7f43a40ced90 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.268+0000 7f43a884a640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 0x7f43a40ce5e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f439400c430 tx=0x7f439400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.269+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394011790 con 0x7f43a40ced90 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.269+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4394017070 con 0x7f43a40ced90 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.269+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394011bb0 con 0x7f43a40ced90 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.269+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a41eaf30 con 0x7f43a40ced90 2024-09-10T09:23:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.269+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a415fb00 con 0x7f43a40ced90 2024-09-10T09:23:01.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.270+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a40b7d70 con 0x7f43a40ced90 2024-09-10T09:23:01.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.270+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f439401c460 con 0x7f43a40ced90 2024-09-10T09:23:01.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.271+0000 7f4399ffb640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f438806be30 0x7f438806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.271+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f439408aae0 con 0x7f43a40ced90 2024-09-10T09:23:01.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.271+0000 7f43a904b640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f438806be30 0x7f438806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.272+0000 7f43a904b640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f438806be30 0x7f438806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43a0034000 tx=0x7f43a002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.275+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43a40ceb20 con 0x7f43a40ced90 2024-09-10T09:23:01.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.465+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f43a4155370 con 0x7f43a40ced90 2024-09-10T09:23:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.465+0000 7f4399ffb640 1 -- 172.21.15.12:0/375308357 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f4394058ed0 con 0x7f43a40ced90 2024-09-10T09:23:01.466 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f438806be30 msgr2=0x7f438806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f438806be30 0x7f438806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43a0034000 tx=0x7f43a002e000 comp rx=0 tx=0).stop 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 msgr2=0x7f43a40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 0x7f43a40ce5e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f439400c430 tx=0x7f439400c8f0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 shutdown_connections 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f438806be30 0x7f438806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f43a415eac0 0x7f43a40b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43a40ced90 0x7f43a40ce5e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 --2- 172.21.15.12:0/375308357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a40b68d0 0x7f43a41548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 >> 172.21.15.12:0/375308357 conn(0x7f43a40d11c0 msgr2=0x7f43a40b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 shutdown_connections 2024-09-10T09:23:01.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.467+0000 7f43ab2af640 1 -- 172.21.15.12:0/375308357 wait complete. 2024-09-10T09:23:01.479 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T09:23:01.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:01.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-10T09:23:01.514 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:23:01.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:01.515 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T09:23:01.580 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:01.580 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:01.598 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:01.599 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:01.654 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:01.654 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:01.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T09:23:01.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.854+0000 7f6813981640 1 Processor -- start 2024-09-10T09:23:01.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.854+0000 7f6813981640 1 -- start start 2024-09-10T09:23:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f6813981640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f680c0b44e0 0x7f680c0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f6813981640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680c073cd0 con 0x7f680c15ec00 2024-09-10T09:23:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f6813981640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680c073fb0 con 0x7f680c073320 2024-09-10T09:23:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f6813981640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f680c06ccb0 con 0x7f680c0b44e0 2024-09-10T09:23:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f681171d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f680c0b44e0 0x7f680c0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f681171d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f680c0b44e0 0x7f680c0d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38846/0 (socket says 172.21.15.12:38846) 2024-09-10T09:23:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f681171d640 1 -- 172.21.15.12:0/4250416059 learned_addr learned my addr 172.21.15.12:0/4250416059 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f6811f1e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f680c15ec00 0x7f680c15f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60242/0 (socket says 172.21.15.12:60242) 2024-09-10T09:23:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f681171d640 1 -- 172.21.15.12:0/4250416059 >> v1:172.21.15.100:6789/0 conn(0x7f680c073320 legacy=0x7f680c0b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f681171d640 1 -- 172.21.15.12:0/4250416059 >> v1:172.21.15.12:6789/0 conn(0x7f680c15ec00 legacy=0x7f680c15f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.855+0000 7f681171d640 1 -- 172.21.15.12:0/4250416059 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c0b6ea0 con 0x7f680c0b44e0 2024-09-10T09:23:01.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.856+0000 7f681171d640 1 --2- 172.21.15.12:0/4250416059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0d1e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6808009870 tx=0x7f680802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1437dffc6fc54ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.856+0000 7f6803fff640 1 -- 172.21.15.12:0/4250416059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808037070 con 0x7f680c0b44e0 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.856+0000 7f6803fff640 1 -- 172.21.15.12:0/4250416059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6808032440 con 0x7f680c0b44e0 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.856+0000 7f6803fff640 1 -- 172.21.15.12:0/4250416059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808032810 con 0x7f680c0b44e0 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 -- 172.21.15.12:0/4250416059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 msgr2=0x7f680c0d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 --2- 172.21.15.12:0/4250416059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0d1e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6808009870 tx=0x7f680802a2a0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 -- 172.21.15.12:0/4250416059 shutdown_connections 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 --2- 172.21.15.12:0/4250416059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0d1e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 -- 172.21.15.12:0/4250416059 >> 172.21.15.12:0/4250416059 conn(0x7f680c062810 msgr2=0x7f680c062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 -- 172.21.15.12:0/4250416059 shutdown_connections 2024-09-10T09:23:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.857+0000 7f6813981640 1 -- 172.21.15.12:0/4250416059 wait complete. 2024-09-10T09:23:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.858+0000 7f6813981640 1 Processor -- start 2024-09-10T09:23:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.858+0000 7f6813981640 1 -- start start 2024-09-10T09:23:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6813981640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f680c073320 0x7f680c15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6813981640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6813981640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f680c15ec00 0x7f680c0d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6813981640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f680c074290 con 0x7f680c0b44e0 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6813981640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f680c0b7460 con 0x7f680c15ec00 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6813981640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f680c15f7a0 con 0x7f680c073320 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38852/0 (socket says 172.21.15.12:38852) 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 -- 172.21.15.12:0/15994342 learned_addr learned my addr 172.21.15.12:0/15994342 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6811f1e640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f680c15ec00 0x7f680c0d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f681171d640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f680c073320 0x7f680c15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 -- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f680c073320 msgr2=0x7f680c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f680c073320 0x7f680c15ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 -- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f680c15ec00 msgr2=0x7f680c0d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f680c15ec00 0x7f680c0d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 -- 172.21.15.12:0/15994342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c0d1980 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6811f1e640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f680c15ec00 0x7f680c0d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.859+0000 7f6810f1c640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0ceae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00c410 tx=0x7f67fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.860+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc017070 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.860+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67fc0035f0 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.860+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c156590 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.860+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc003a20 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.860+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c156b50 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.861+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c0d1e20 con 0x7f680c0b44e0 2024-09-10T09:23:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.862+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67fc01a070 con 0x7f680c0b44e0 2024-09-10T09:23:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.862+0000 7f6801ffb640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f67f006be60 0x7f67f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.862+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67fc08a2b0 con 0x7f680c0b44e0 2024-09-10T09:23:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.862+0000 7f681171d640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f67f006be60 0x7f67f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.863+0000 7f681171d640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f67f006be60 0x7f67f006e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6808034000 tx=0x7f680802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:01.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:01.866+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67fc058cf0 con 0x7f680c0b44e0 2024-09-10T09:23:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.057+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f680c069160 con 0x7f680c0b44e0 2024-09-10T09:23:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.058+0000 7f6801ffb640 1 -- 172.21.15.12:0/15994342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f67fc0010c0 con 0x7f680c0b44e0 2024-09-10T09:23:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f67f006be60 msgr2=0x7f67f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f67f006be60 0x7f67f006e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6808034000 tx=0x7f680802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 msgr2=0x7f680c0ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0ceae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00c410 tx=0x7f67fc00c8d0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 shutdown_connections 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f67f006be60 0x7f67f006e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f680c15ec00 0x7f680c0d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680c0b44e0 0x7f680c0ceae0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 --2- 172.21.15.12:0/15994342 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f680c073320 0x7f680c15ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 >> 172.21.15.12:0/15994342 conn(0x7f680c062810 msgr2=0x7f680c06e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 shutdown_connections 2024-09-10T09:23:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.060+0000 7f6813981640 1 -- 172.21.15.12:0/15994342 wait complete. 2024-09-10T09:23:02.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-10T09:23:02.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:02.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-10T09:23:02.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:23:02.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:02.098 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T09:23:02.155 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:02.155 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:02.174 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:02.175 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:02.234 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:02.234 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:02.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T09:23:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.396+0000 7f15d4711640 1 Processor -- start 2024-09-10T09:23:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.396+0000 7f15d4711640 1 -- start start 2024-09-10T09:23:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d4711640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d4711640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15cc15ce80 0x7f15cc1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d4711640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc15d390 con 0x7f15cc0d02a0 2024-09-10T09:23:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d4711640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc15d670 con 0x7f15cc15ce80 2024-09-10T09:23:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d4711640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc15d950 con 0x7f15cc15ca40 2024-09-10T09:23:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d2cae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15cc15ce80 0x7f15cc1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d2cae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15cc15ce80 0x7f15cc1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38862/0 (socket says 172.21.15.12:38862) 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d2cae640 1 -- 172.21.15.12:0/372864035 learned_addr learned my addr 172.21.15.12:0/372864035 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d1cac640 1 --2- 172.21.15.12:0/372864035 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d2cae640 1 -- 172.21.15.12:0/372864035 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 msgr2=0x7f15cc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d2cae640 1 --2- 172.21.15.12:0/372864035 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.397+0000 7f15d2cae640 1 -- 172.21.15.12:0/372864035 >> v1:172.21.15.100:6789/0 conn(0x7f15cc0d02a0 legacy=0x7f15cc0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.398+0000 7f15d2cae640 1 -- 172.21.15.12:0/372864035 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc15dc30 con 0x7f15cc15ce80 2024-09-10T09:23:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.398+0000 7f15d2cae640 1 --2- 172.21.15.12:0/372864035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc1594c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00d150 tx=0x7f15bc02c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65008b18f957b013 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.398+0000 7f15d14ab640 1 -- 172.21.15.12:0/372864035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc039070 con 0x7f15cc15ce80 2024-09-10T09:23:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.398+0000 7f15d14ab640 1 -- 172.21.15.12:0/372864035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc009600 con 0x7f15cc15ce80 2024-09-10T09:23:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.398+0000 7f15d14ab640 1 -- 172.21.15.12:0/372864035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0099d0 con 0x7f15cc15ce80 2024-09-10T09:23:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 -- 172.21.15.12:0/372864035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 msgr2=0x7f15cc1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 --2- 172.21.15.12:0/372864035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc1594c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00d150 tx=0x7f15bc02c840 comp rx=0 tx=0).stop 2024-09-10T09:23:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 -- 172.21.15.12:0/372864035 shutdown_connections 2024-09-10T09:23:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 --2- 172.21.15.12:0/372864035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc1594c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 --2- 172.21.15.12:0/372864035 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 -- 172.21.15.12:0/372864035 >> 172.21.15.12:0/372864035 conn(0x7f15cc062cc0 msgr2=0x7f15cc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 -- 172.21.15.12:0/372864035 shutdown_connections 2024-09-10T09:23:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.399+0000 7f15d4711640 1 -- 172.21.15.12:0/372864035 wait complete. 2024-09-10T09:23:02.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.400+0000 7f15d4711640 1 Processor -- start 2024-09-10T09:23:02.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.400+0000 7f15d4711640 1 -- start start 2024-09-10T09:23:02.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d4711640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0d02a0 0x7f15cc1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d4711640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d4711640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc14c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d4711640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc155d10 con 0x7f15cc15ce80 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d4711640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc155b90 con 0x7f15cc0d02a0 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d4711640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc0b4790 con 0x7f15cc15ca40 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc14c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc14c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38874/0 (socket says 172.21.15.12:38874) 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 -- 172.21.15.12:0/1075174738 learned_addr learned my addr 172.21.15.12:0/1075174738 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d24ad640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0d02a0 0x7f15cc1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d1cac640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 -- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 msgr2=0x7f15cc14beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc14beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 -- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0d02a0 msgr2=0x7f15cc1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0d02a0 0x7f15cc1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d2cae640 1 -- 172.21.15.12:0/1075174738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc143710 con 0x7f15cc15ce80 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.401+0000 7f15d24ad640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0d02a0 0x7f15cc1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.402+0000 7f15d2cae640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc14c3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15bc037040 tx=0x7f15bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.402+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc039040 con 0x7f15cc15ce80 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.402+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc009370 con 0x7f15cc15ce80 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.402+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc1439f0 con 0x7f15cc15ce80 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.402+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc03f8b0 con 0x7f15cc15ce80 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.402+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc0b2dc0 con 0x7f15cc15ce80 2024-09-10T09:23:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.403+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc0b41e0 con 0x7f15cc15ce80 2024-09-10T09:23:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.403+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15bc03fa50 con 0x7f15cc15ce80 2024-09-10T09:23:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.404+0000 7f15caffd640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15b806be30 0x7f15b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.404+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15bc0aba20 con 0x7f15cc15ce80 2024-09-10T09:23:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.404+0000 7f15d24ad640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15b806be30 0x7f15b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.405+0000 7f15d24ad640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15b806be30 0x7f15b806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15c4006fd0 tx=0x7f15c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.408+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15bc031070 con 0x7f15cc15ce80 2024-09-10T09:23:02.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.598+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f15cc06d440 con 0x7f15cc15ce80 2024-09-10T09:23:02.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.598+0000 7f15caffd640 1 -- 172.21.15.12:0/1075174738 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f15bc07a580 con 0x7f15cc15ce80 2024-09-10T09:23:02.599 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15b806be30 msgr2=0x7f15b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15b806be30 0x7f15b806e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15c4006fd0 tx=0x7f15c4008040 comp rx=0 tx=0).stop 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 msgr2=0x7f15cc14c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc14c3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15bc037040 tx=0x7f15bc004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 shutdown_connections 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15b806be30 0x7f15b806e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15cc15ce80 0x7f15cc14c3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15ca40 0x7f15cc14beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 --2- 172.21.15.12:0/1075174738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0d02a0 0x7f15cc1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 >> 172.21.15.12:0/1075174738 conn(0x7f15cc062cc0 msgr2=0x7f15cc0b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 shutdown_connections 2024-09-10T09:23:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.600+0000 7f15d4711640 1 -- 172.21.15.12:0/1075174738 wait complete. 2024-09-10T09:23:02.612 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-10T09:23:02.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:02.612 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-10T09:23:02.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:23:02.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:02.645 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T09:23:02.703 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T09:23:02.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.806+0000 7fcba556d640 1 Processor -- start 2024-09-10T09:23:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.806+0000 7fcba556d640 1 -- start start 2024-09-10T09:23:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcba556d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 0x7fcba00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcba556d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcba00b7aa0 0x7fcba00b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcba556d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba00d34d0 con 0x7fcba00b61f0 2024-09-10T09:23:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcba556d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcba00d3790 con 0x7fcba00b7aa0 2024-09-10T09:23:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcba556d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcba00d3a70 con 0x7fcba015e860 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcb9f7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcba00b7aa0 0x7fcba00b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcb9effd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 0x7fcba00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcb9effd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 0x7fcba00cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:43196/0 (socket says 172.21.15.12:43196) 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcb9f7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcba00b7aa0 0x7fcba00b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:51134/0 (socket says 172.21.15.12:51134) 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcb9effd640 1 -- 172.21.15.12:0/3475372240 learned_addr learned my addr 172.21.15.12:0/3475372240 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.807+0000 7fcb9e7fc640 1 --1- 172.21.15.12:0/3475372240 >> v1:172.21.15.100:6789/0 conn(0x7fcba00b61f0 0x7fcba00b6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:59172/0 (socket says 172.21.15.12:59172) 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.808+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 msgr2=0x7fcba00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.808+0000 7fcb9f7fe640 1 --2- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 0x7fcba00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.808+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/3475372240 >> v1:172.21.15.100:6789/0 conn(0x7fcba00b61f0 legacy=0x7fcba00b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.808+0000 7fcb9dffb640 1 -- 172.21.15.12:0/3475372240 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826214808 0 0) 0x7fcba00d34d0 con 0x7fcba00b61f0 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.808+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/3475372240 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba00d3d50 con 0x7fcba00b7aa0 2024-09-10T09:23:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.808+0000 7fcb9effd640 1 --2- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 0x7fcba00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcb9f7fe640 1 --2- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b7aa0 0x7fcba00b7f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009d90 tx=0x7fcb9802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b593231ac798d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcb9dffb640 1 -- 172.21.15.12:0/3475372240 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98007740 con 0x7fcba00b7aa0 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcb9dffb640 1 -- 172.21.15.12:0/3475372240 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb980078e0 con 0x7fcba00b7aa0 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcb9dffb640 1 -- 172.21.15.12:0/3475372240 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98007cb0 con 0x7fcba00b7aa0 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 -- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b7aa0 msgr2=0x7fcba00b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 --2- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b7aa0 0x7fcba00b7f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009d90 tx=0x7fcb9802a6f0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 -- 172.21.15.12:0/3475372240 shutdown_connections 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 --2- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b7aa0 0x7fcba00b7f10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 --2- 172.21.15.12:0/3475372240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba015e860 0x7fcba00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 -- 172.21.15.12:0/3475372240 >> 172.21.15.12:0/3475372240 conn(0x7fcba0062c60 msgr2=0x7fcba00d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.809+0000 7fcba556d640 1 -- 172.21.15.12:0/3475372240 shutdown_connections 2024-09-10T09:23:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.810+0000 7fcba556d640 1 -- 172.21.15.12:0/3475372240 wait complete. 2024-09-10T09:23:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.811+0000 7fcba556d640 1 Processor -- start 2024-09-10T09:23:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.811+0000 7fcba556d640 1 -- start start 2024-09-10T09:23:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcba556d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b61f0 0x7fcba00b9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcba556d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba00b7aa0 0x7fcba015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcba556d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 0x7fcba014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcba556d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcba015ec40 con 0x7fcba015e860 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcba556d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcba00d4310 con 0x7fcba00b61f0 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcba556d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcba015edc0 con 0x7fcba00b7aa0 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 0x7fcba014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 0x7fcba014d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43478/0 (socket says 172.21.15.12:43478) 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/4050279534 learned_addr learned my addr 172.21.15.12:0/4050279534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9effd640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b61f0 0x7fcba00b9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9e7fc640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba00b7aa0 0x7fcba015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba00b7aa0 msgr2=0x7fcba015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba00b7aa0 0x7fcba015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b61f0 msgr2=0x7fcba00b9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b61f0 0x7fcba00b9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 -- 172.21.15.12:0/4050279534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba00cbb30 con 0x7fcba015e860 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.812+0000 7fcb9f7fe640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 0x7fcba014d670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009d90 tx=0x7fcb98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.813+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98040070 con 0x7fcba015e860 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.813+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98031c40 con 0x7fcba015e860 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.813+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba00cbe10 con 0x7fcba015e860 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.813+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98009450 con 0x7fcba015e860 2024-09-10T09:23:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.813+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba00cc6b0 con 0x7fcba015e860 2024-09-10T09:23:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.814+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba00b3ad0 con 0x7fcba015e860 2024-09-10T09:23:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.814+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb98039040 con 0x7fcba015e860 2024-09-10T09:23:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.815+0000 7fcb877fe640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.815+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb980abee0 con 0x7fcba015e860 2024-09-10T09:23:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.815+0000 7fcb9effd640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.815+0000 7fcb9effd640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb90006ca0 tx=0x7fcb90009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:02.819+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb9807a2d0 con 0x7fcba015e860 2024-09-10T09:23:03.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.034+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcba00ccdb0 con 0x7fcba015e860 2024-09-10T09:23:03.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.035+0000 7fcb877fe640 1 -- 172.21.15.12:0/4050279534 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fcb9807e5d0 con 0x7fcba015e860 2024-09-10T09:23:03.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:03.036 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:23:03.036 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fcb8c06be30 msgr2=0x7fcb8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb90006ca0 tx=0x7fcb90009240 comp rx=0 tx=0).stop 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 msgr2=0x7fcba014d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 0x7fcba014d670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009d90 tx=0x7fcb98004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 shutdown_connections 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcba015e860 0x7fcba014d670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcba00b7aa0 0x7fcba015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 --2- 172.21.15.12:0/4050279534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba00b61f0 0x7fcba00b9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 >> 172.21.15.12:0/4050279534 conn(0x7fcba0062c60 msgr2=0x7fcba00cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 shutdown_connections 2024-09-10T09:23:03.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.037+0000 7fcba556d640 1 -- 172.21.15.12:0/4050279534 wait complete. 2024-09-10T09:23:03.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.150+0000 7f7867966640 1 Processor -- start 2024-09-10T09:23:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.151+0000 7f7867966640 1 -- start start 2024-09-10T09:23:03.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.151+0000 7f7867966640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f786015ed20 0x7f78600b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.151+0000 7f7867966640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78600b7170 con 0x7f786015e940 2024-09-10T09:23:03.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.151+0000 7f7867966640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78600b7aa0 con 0x7f78600cef90 2024-09-10T09:23:03.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.151+0000 7f7867966640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f78600d3660 con 0x7f786015ed20 2024-09-10T09:23:03.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7865702640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f786015e940 0x7f78600d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36626/0 (socket says 172.21.15.12:36626) 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7865702640 1 -- 172.21.15.12:0/3567905333 learned_addr learned my addr 172.21.15.12:0/3567905333 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909865005 0 0) 0x7f785c001110 con 0x7f786015e940 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7864f01640 1 --2- 172.21.15.12:0/3567905333 >> v2:172.21.15.100:3300/0 conn(0x7f786015ed20 0x7f78600b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f784c003520 con 0x7f786015e940 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2669186288 0 0) 0x7f784c003520 con 0x7f786015e940 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 >> v2:172.21.15.100:3300/0 conn(0x7f786015ed20 msgr2=0x7f78600b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 --2- 172.21.15.12:0/3567905333 >> v2:172.21.15.100:3300/0 conn(0x7f786015ed20 0x7f78600b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 >> v1:172.21.15.100:6789/0 conn(0x7f78600cef90 legacy=0x7f78600b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78600d3940 con 0x7f786015e940 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f785c001840 con 0x7f786015e940 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 >> v1:172.21.15.12:6789/0 conn(0x7f786015e940 legacy=0x7f78600d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0039b0 0x7f784c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f784c004800 0x7f784c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f784c0051c0 0x7f784c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78600d3660 con 0x7f784c0051c0 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f784c00c070 con 0x7f784c0039b0 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f784c00c270 con 0x7f784c004800 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7865702640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0039b0 0x7f784c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7865f03640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f784c0051c0 0x7f784c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.152+0000 7f7864f01640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f784c004800 0x7f784c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 -- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f784c004800 msgr2=0x7f784c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f784c004800 0x7f784c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 -- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0039b0 msgr2=0x7f784c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0039b0 0x7f784c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 -- 172.21.15.12:0/3567905333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c003520 con 0x7f784c0051c0 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865702640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0039b0 0x7f784c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:03.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 -- 172.21.15.12:0/3567905333 reap_dead start 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.153+0000 7f7865f03640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f784c0051c0 0x7f784c00b9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7858001e50 tx=0x7f784c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb6c48b67a7a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c00c0e0 con 0x7f784c0051c0 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7858003970 con 0x7f784c0051c0 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7857fff640 1 -- 172.21.15.12:0/3567905333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858001a70 con 0x7f784c0051c0 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 -- 172.21.15.12:0/3567905333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f784c0051c0 msgr2=0x7f784c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f784c0051c0 0x7f784c00b9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7858001e50 tx=0x7f784c005830 comp rx=0 tx=0).stop 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 -- 172.21.15.12:0/3567905333 shutdown_connections 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 --2- 172.21.15.12:0/3567905333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f784c0051c0 0x7f784c00b9c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 -- 172.21.15.12:0/3567905333 >> 172.21.15.12:0/3567905333 conn(0x7f78600b6240 msgr2=0x7f78600b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 -- 172.21.15.12:0/3567905333 shutdown_connections 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.154+0000 7f7867966640 1 -- 172.21.15.12:0/3567905333 wait complete. 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 Processor -- start 2024-09-10T09:23:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 -- start start 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0051c0 0x7f786015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f786015a6b0 0x7f78600c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 0x7f786015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78600d1ef0 con 0x7f786015ced0 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f78600d3f00 con 0x7f784c0051c0 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7867966640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f78600d2070 con 0x7f786015a6b0 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7865f03640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 0x7f786015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7865f03640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 0x7f786015d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43510/0 (socket says 172.21.15.12:43510) 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.156+0000 7f7865f03640 1 -- 172.21.15.12:0/936359465 learned_addr learned my addr 172.21.15.12:0/936359465 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7864f01640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f786015a6b0 0x7f78600c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865702640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0051c0 0x7f786015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865f03640 1 -- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f786015a6b0 msgr2=0x7f78600c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865f03640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f786015a6b0 0x7f78600c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865f03640 1 -- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0051c0 msgr2=0x7f786015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865f03640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0051c0 0x7f786015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865f03640 1 -- 172.21.15.12:0/936359465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78601f7ef0 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865702640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0051c0 0x7f786015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7865f03640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 0x7f786015d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7858001f70 tx=0x7f78580014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858007db0 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7858001250 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78601f81d0 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858006b50 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.157+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78600ca110 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.158+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78600d1060 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.159+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f785803b030 con 0x7f786015ced0 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.159+0000 7f7855ffb640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f784406be30 0x7f784406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.159+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f78580a9e60 con 0x7f786015ced0 2024-09-10T09:23:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.160+0000 7f7865702640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f784406be30 0x7f784406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.160+0000 7f7865702640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f784406be30 0x7f784406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f785c0016c0 tx=0x7f785c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.164+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7858078810 con 0x7f786015ced0 2024-09-10T09:23:03.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.378+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78600ba6b0 con 0x7f786015ced0 2024-09-10T09:23:03.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.379+0000 7f7855ffb640 1 -- 172.21.15.12:0/936359465 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f7858078110 con 0x7f786015ced0 2024-09-10T09:23:03.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:03.380 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:23:03.380 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f784406be30 msgr2=0x7f784406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f784406be30 0x7f784406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f785c0016c0 tx=0x7f785c009040 comp rx=0 tx=0).stop 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 msgr2=0x7f786015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 0x7f786015d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7858001f70 tx=0x7f78580014a0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 shutdown_connections 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f784406be30 0x7f784406e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786015ced0 0x7f786015d350 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f786015a6b0 0x7f78600c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 --2- 172.21.15.12:0/936359465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f784c0051c0 0x7f786015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 >> 172.21.15.12:0/936359465 conn(0x7f78600b6240 msgr2=0x7f78601618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 shutdown_connections 2024-09-10T09:23:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.381+0000 7f7867966640 1 -- 172.21.15.12:0/936359465 wait complete. 2024-09-10T09:23:03.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:03.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.494+0000 7fd2ed511640 1 Processor -- start 2024-09-10T09:23:03.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.494+0000 7fd2ed511640 1 -- start start 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.495+0000 7fd2ed511640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.495+0000 7fd2ed511640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2e815f400 0x7fd2e80b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.495+0000 7fd2ed511640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e815fbf0 con 0x7fd2e8148330 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.495+0000 7fd2ed511640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e80b4f80 con 0x7fd2e815f400 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.495+0000 7fd2ed511640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e80b5260 con 0x7fd2e806c2b0 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.495+0000 7fd2e77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2e815f400 0x7fd2e80b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e6ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd2e8148330 0x7fd2e806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36632/0 (socket says 172.21.15.12:36632) 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e6ffd640 1 -- 172.21.15.12:0/2993733458 learned_addr learned my addr 172.21.15.12:0/2993733458 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e67fc640 1 --2- 172.21.15.12:0/2993733458 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e77fe640 1 -- 172.21.15.12:0/2993733458 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 msgr2=0x7fd2e815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:03.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e77fe640 1 --2- 172.21.15.12:0/2993733458 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e815eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e77fe640 1 -- 172.21.15.12:0/2993733458 >> v1:172.21.15.12:6789/0 conn(0x7fd2e8148330 legacy=0x7fd2e806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e77fe640 1 -- 172.21.15.12:0/2993733458 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80b5540 con 0x7fd2e815f400 2024-09-10T09:23:03.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.496+0000 7fd2e5ffb640 1 -- 172.21.15.12:0/2993733458 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898952761 0 0) 0x7fd2e815fbf0 con 0x7fd2e8148330 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2e77fe640 1 --2- 172.21.15.12:0/2993733458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e815f400 0x7fd2e80b5d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009dc0 tx=0x7fd2d802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d861fc4cb07aff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2e5ffb640 1 -- 172.21.15.12:0/2993733458 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8007740 con 0x7fd2e815f400 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2e5ffb640 1 -- 172.21.15.12:0/2993733458 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80078e0 con 0x7fd2e815f400 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2e5ffb640 1 -- 172.21.15.12:0/2993733458 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8007cb0 con 0x7fd2e815f400 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 -- 172.21.15.12:0/2993733458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e815f400 msgr2=0x7fd2e80b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 --2- 172.21.15.12:0/2993733458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e815f400 0x7fd2e80b5d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009dc0 tx=0x7fd2d802a5f0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 -- 172.21.15.12:0/2993733458 shutdown_connections 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 --2- 172.21.15.12:0/2993733458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e815f400 0x7fd2e80b5d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 --2- 172.21.15.12:0/2993733458 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 -- 172.21.15.12:0/2993733458 >> 172.21.15.12:0/2993733458 conn(0x7fd2e8062a80 msgr2=0x7fd2e806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 -- 172.21.15.12:0/2993733458 shutdown_connections 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.497+0000 7fd2ed511640 1 -- 172.21.15.12:0/2993733458 wait complete. 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 Processor -- start 2024-09-10T09:23:03.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 -- start start 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e8156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 0x7fd2e81f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e815f400 0x7fd2e813cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e815fe50 con 0x7fd2e8148330 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e815f8b0 con 0x7fd2e815f400 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2ed511640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e815ffd0 con 0x7fd2e806c2b0 2024-09-10T09:23:03.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.499+0000 7fd2e67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 0x7fd2e81f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 0x7fd2e81f7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43518/0 (socket says 172.21.15.12:43518) 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 -- 172.21.15.12:0/1688958157 learned_addr learned my addr 172.21.15.12:0/1688958157 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e6ffd640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e8156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e77fe640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e815f400 0x7fd2e813cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 -- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 msgr2=0x7fd2e8156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e8156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 -- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e815f400 msgr2=0x7fd2e813cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e815f400 0x7fd2e813cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 -- 172.21.15.12:0/1688958157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e81f8980 con 0x7fd2e8148330 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2e67fc640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 0x7fd2e81f7ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000d830 tx=0x7fd2d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000b6c0 con 0x7fd2e8148330 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d0019070 con 0x7fd2e8148330 2024-09-10T09:23:03.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e81f83c0 con 0x7fd2e8148330 2024-09-10T09:23:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000ba80 con 0x7fd2e8148330 2024-09-10T09:23:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.500+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e80cce80 con 0x7fd2e8148330 2024-09-10T09:23:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.501+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e815eec0 con 0x7fd2e8148330 2024-09-10T09:23:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.502+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2d001e460 con 0x7fd2e8148330 2024-09-10T09:23:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.502+0000 7fd2df7fe640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd2c806be30 0x7fd2c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.502+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd2d008b3d0 con 0x7fd2e8148330 2024-09-10T09:23:03.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.502+0000 7fd2e6ffd640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd2c806be30 0x7fd2c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.503+0000 7fd2e6ffd640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd2c806be30 0x7fd2c806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0000f60 tx=0x7fd2e0007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.507+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2d0059730 con 0x7fd2e8148330 2024-09-10T09:23:03.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.683+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2e806e8a0 con 0x7fd2e8148330 2024-09-10T09:23:03.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.684+0000 7fd2df7fe640 1 -- 172.21.15.12:0/1688958157 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fd2d005da30 con 0x7fd2e8148330 2024-09-10T09:23:03.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:03.686 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd2c806be30 msgr2=0x7fd2c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd2c806be30 0x7fd2c806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0000f60 tx=0x7fd2e0007d50 comp rx=0 tx=0).stop 2024-09-10T09:23:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 msgr2=0x7fd2e81f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 0x7fd2e81f7ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000d830 tx=0x7fd2d000dcf0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 shutdown_connections 2024-09-10T09:23:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd2c806be30 0x7fd2c806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2e815f400 0x7fd2e813cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e8148330 0x7fd2e81f7ac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 --2- 172.21.15.12:0/1688958157 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd2e806c2b0 0x7fd2e8156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 >> 172.21.15.12:0/1688958157 conn(0x7fd2e8062a80 msgr2=0x7fd2e806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:03.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 shutdown_connections 2024-09-10T09:23:03.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.686+0000 7fd2ed511640 1 -- 172.21.15.12:0/1688958157 wait complete. 2024-09-10T09:23:03.698 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T09:23:03.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:03.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:23:03.765 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:23:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.802+0000 7fd495cd0640 1 Processor -- start 2024-09-10T09:23:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.802+0000 7fd495cd0640 1 -- start start 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd495cd0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4900b1980 0x7fd4900b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd495cd0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4900b4290 0x7fd4900b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd495cd0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd490073da0 con 0x7fd49015c690 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd495cd0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd490074060 con 0x7fd4900b4290 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd495cd0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd4900b6aa0 con 0x7fd4900b1980 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4900b4290 0x7fd4900b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd49015c690 0x7fd4900d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36640/0 (socket says 172.21.15.12:36640) 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48f7fe640 1 -- 172.21.15.12:0/3192870878 learned_addr learned my addr 172.21.15.12:0/3192870878 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48effd640 1 --2- 172.21.15.12:0/3192870878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4900b1980 0x7fd4900b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48ffff640 1 -- 172.21.15.12:0/3192870878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4900b1980 msgr2=0x7fd4900b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48ffff640 1 --2- 172.21.15.12:0/3192870878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4900b1980 0x7fd4900b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48ffff640 1 -- 172.21.15.12:0/3192870878 >> v1:172.21.15.12:6789/0 conn(0x7fd49015c690 legacy=0x7fd4900d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.803+0000 7fd48ffff640 1 -- 172.21.15.12:0/3192870878 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4900733a0 con 0x7fd4900b4290 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.804+0000 7fd48ffff640 1 --2- 172.21.15.12:0/3192870878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b4290 0x7fd4900b4720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd488009d90 tx=0x7fd48802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c778f8fc92271c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.804+0000 7fd48e7fc640 1 -- 172.21.15.12:0/3192870878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488007740 con 0x7fd4900b4290 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.804+0000 7fd48e7fc640 1 -- 172.21.15.12:0/3192870878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4880078e0 con 0x7fd4900b4290 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.804+0000 7fd48e7fc640 1 -- 172.21.15.12:0/3192870878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488007cb0 con 0x7fd4900b4290 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 -- 172.21.15.12:0/3192870878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b4290 msgr2=0x7fd4900b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 --2- 172.21.15.12:0/3192870878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b4290 0x7fd4900b4720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd488009d90 tx=0x7fd48802a660 comp rx=0 tx=0).stop 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 -- 172.21.15.12:0/3192870878 shutdown_connections 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 --2- 172.21.15.12:0/3192870878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b4290 0x7fd4900b4720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 --2- 172.21.15.12:0/3192870878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4900b1980 0x7fd4900b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 -- 172.21.15.12:0/3192870878 >> 172.21.15.12:0/3192870878 conn(0x7fd490062630 msgr2=0x7fd490062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 -- 172.21.15.12:0/3192870878 shutdown_connections 2024-09-10T09:23:03.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.805+0000 7fd495cd0640 1 -- 172.21.15.12:0/3192870878 wait complete. 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.806+0000 7fd495cd0640 1 Processor -- start 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.806+0000 7fd495cd0640 1 -- start start 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd495cd0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 0x7fd4901554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd495cd0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4900b4290 0x7fd49015f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd495cd0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd49015c690 0x7fd490153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd495cd0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4900d0dd0 con 0x7fd4900b1980 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd495cd0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4900d0c50 con 0x7fd4900b4290 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd495cd0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd4900b6fc0 con 0x7fd49015c690 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 0x7fd4901554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 0x7fd4901554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43534/0 (socket says 172.21.15.12:43534) 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 -- 172.21.15.12:0/2071670390 learned_addr learned my addr 172.21.15.12:0/2071670390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48ffff640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd49015c690 0x7fd490153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48effd640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4900b4290 0x7fd49015f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 -- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd49015c690 msgr2=0x7fd490153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd49015c690 0x7fd490153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 -- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4900b4290 msgr2=0x7fd49015f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4900b4290 0x7fd49015f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.807+0000 7fd48f7fe640 1 -- 172.21.15.12:0/2071670390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd490155b50 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.808+0000 7fd48f7fe640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 0x7fd4901554c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c3c0 tx=0x7fd48000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.808+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480017070 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.808+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd480005ce0 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.808+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd490155e30 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.808+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4800072f0 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.808+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4901563f0 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.809+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd490158ff0 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.809+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd48001a070 con 0x7fd4900b1980 2024-09-10T09:23:03.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.810+0000 7fd477fff640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd47c06be60 0x7fd47c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:03.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.810+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd48008a100 con 0x7fd4900b1980 2024-09-10T09:23:03.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.810+0000 7fd48effd640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd47c06be60 0x7fd47c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:03.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.811+0000 7fd48effd640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd47c06be60 0x7fd47c06e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4900691d0 tx=0x7fd484008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:03.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:03.814+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd480058470 con 0x7fd4900b1980 2024-09-10T09:23:04.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.025+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd49015b0a0 con 0x7fd4900b1980 2024-09-10T09:23:04.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.026+0000 7fd477fff640 1 -- 172.21.15.12:0/2071670390 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fd48005c770 con 0x7fd4900b1980 2024-09-10T09:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:04.027 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:23:04.027 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd47c06be60 msgr2=0x7fd47c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd47c06be60 0x7fd47c06e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4900691d0 tx=0x7fd484008040 comp rx=0 tx=0).stop 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 msgr2=0x7fd4901554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 0x7fd4901554c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c3c0 tx=0x7fd48000c880 comp rx=0 tx=0).stop 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 shutdown_connections 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fd47c06be60 0x7fd47c06e320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd49015c690 0x7fd490153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4900b4290 0x7fd49015f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 --2- 172.21.15.12:0/2071670390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4900b1980 0x7fd4901554c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 >> 172.21.15.12:0/2071670390 conn(0x7fd490062630 msgr2=0x7fd4900d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 shutdown_connections 2024-09-10T09:23:04.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.028+0000 7fd495cd0640 1 -- 172.21.15.12:0/2071670390 wait complete. 2024-09-10T09:23:04.040 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:04.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.142+0000 7f5d9841e640 1 Processor -- start 2024-09-10T09:23:04.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.142+0000 7f5d9841e640 1 -- start start 2024-09-10T09:23:04.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d9841e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d9015e940 0x7f5d900d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d9841e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 0x7f5d900d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d9841e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d900b7170 con 0x7f5d900cef90 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d9841e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5d900d1ae0 con 0x7f5d9015e940 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d9841e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900b7aa0 con 0x7f5d9015ed20 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d969bb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5d900cef90 0x7f5d900b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36654/0 (socket says 172.21.15.12:36654) 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d969bb640 1 -- 172.21.15.12:0/502260595 learned_addr learned my addr 172.21.15.12:0/502260595 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d959b9640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 0x7f5d900d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d961ba640 1 --2- 172.21.15.12:0/502260595 >> v2:172.21.15.100:3300/0 conn(0x7f5d9015e940 0x7f5d900d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525219712 0 0) 0x7f5d88001490 con 0x7f5d900cef90 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d7c003520 con 0x7f5d900cef90 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 929431222 0 0) 0x7f5d7c003520 con 0x7f5d900cef90 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 msgr2=0x7f5d900d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 0x7f5d900d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 >> v2:172.21.15.100:3300/0 conn(0x7f5d9015e940 msgr2=0x7f5d900d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 --2- 172.21.15.12:0/502260595 >> v2:172.21.15.100:3300/0 conn(0x7f5d9015e940 0x7f5d900d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900d3660 con 0x7f5d900cef90 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f5d88001bc0 con 0x7f5d900cef90 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.143+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 >> v1:172.21.15.12:6789/0 conn(0x7f5d900cef90 legacy=0x7f5d900b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d951b8640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 0x7f5d7c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d951b8640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d951b8640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d7c004d40 0x7f5d7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900b7aa0 con 0x7f5d7c003f80 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c00b9c0 con 0x7f5d7c004d40 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c00bbc0 con 0x7f5d9015ed20 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d959b9640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d961ba640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 0x7f5d7c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d969bb640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d7c004d40 0x7f5d7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d959b9640 1 -- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 msgr2=0x7f5d7c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d959b9640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015ed20 0x7f5d7c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d959b9640 1 -- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d7c004d40 msgr2=0x7f5d7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d959b9640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d7c004d40 0x7f5d7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.144+0000 7f5d959b9640 1 -- 172.21.15.12:0/502260595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c003520 con 0x7f5d7c003f80 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d959b9640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d7c004800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009ac0 tx=0x7f5d7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3c9f2b8cfaef02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80036070 con 0x7f5d7c003f80 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d80031400 con 0x7f5d7c003f80 2024-09-10T09:23:04.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d951b8640 1 -- 172.21.15.12:0/502260595 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80009690 con 0x7f5d7c003f80 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d9841e640 1 -- 172.21.15.12:0/502260595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 msgr2=0x7f5d7c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d9841e640 1 --2- 172.21.15.12:0/502260595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d7c004800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009ac0 tx=0x7f5d7c005830 comp rx=0 tx=0).stop 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d969bb640 1 -- 172.21.15.12:0/502260595 reap_dead start 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d9841e640 1 -- 172.21.15.12:0/502260595 shutdown_connections 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.145+0000 7f5d9841e640 1 -- 172.21.15.12:0/502260595 >> 172.21.15.12:0/502260595 conn(0x7f5d900b6240 msgr2=0x7f5d900b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.146+0000 7f5d9841e640 1 -- 172.21.15.12:0/502260595 shutdown_connections 2024-09-10T09:23:04.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.146+0000 7f5d9841e640 1 -- 172.21.15.12:0/502260595 wait complete. 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 Processor -- start 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 -- start start 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d90157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015a4f0 0x7f5d9015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d900cd9d0 0x7f5d900cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900d3f00 con 0x7f5d7c003f80 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900d3c20 con 0x7f5d900cd9d0 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.147+0000 7f5d9841e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900d3310 con 0x7f5d9015a4f0 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d90157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d90157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43542/0 (socket says 172.21.15.12:43542) 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 -- 172.21.15.12:0/2528043868 learned_addr learned my addr 172.21.15.12:0/2528043868 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d959b9640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015a4f0 0x7f5d9015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d969bb640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d900cd9d0 0x7f5d900cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 -- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015a4f0 msgr2=0x7f5d9015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015a4f0 0x7f5d9015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 -- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d900cd9d0 msgr2=0x7f5d900cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d900cd9d0 0x7f5d900cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 -- 172.21.15.12:0/2528043868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d90158140 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d961ba640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d90157c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c011aa0 tx=0x7f5d8c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00fb80 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c00fd20 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900c8e10 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c014660 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.148+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d900c93d0 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.149+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d900b9ac0 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.150+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d8c012040 con 0x7f5d7c003f80 2024-09-10T09:23:04.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.150+0000 7f5d86ffd640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5d7406be60 0x7f5d7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.150+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d8c08b4d0 con 0x7f5d7c003f80 2024-09-10T09:23:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.150+0000 7f5d959b9640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5d7406be60 0x7f5d7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.151+0000 7f5d959b9640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5d7406be60 0x7f5d7406e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d80033000 tx=0x7f5d80008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.155+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d900b9ac0 con 0x7f5d7c003f80 2024-09-10T09:23:04.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.368+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d900d1ef0 con 0x7f5d7c003f80 2024-09-10T09:23:04.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.369+0000 7f5d86ffd640 1 -- 172.21.15.12:0/2528043868 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f5d8c089e20 con 0x7f5d7c003f80 2024-09-10T09:23:04.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:04.370 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-10T09:22:41:945343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/316895221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":316895221},{"type":"v1","addr":"172.21.15.12:6833","nonce":316895221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3199585078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3199585078},{"type":"v1","addr":"172.21.15.12:6835","nonce":3199585078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2907899985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2907899985},{"type":"v1","addr":"172.21.15.100:6835","nonce":2907899985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:22:38.285526+0000","modified":"2024-09-10T09:22:41.208280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/4014482573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4014482573},{"type":"v1","addr":"172.21.15.100:6837","nonce":4014482573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-10T09:23:04.370 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5d7406be60 msgr2=0x7f5d7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5d7406be60 0x7f5d7406e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d80033000 tx=0x7f5d80008030 comp rx=0 tx=0).stop 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 msgr2=0x7f5d90157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d90157c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c011aa0 tx=0x7f5d8c011f60 comp rx=0 tx=0).stop 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 shutdown_connections 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5d7406be60 0x7f5d7406e320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d900cd9d0 0x7f5d900cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5d9015a4f0 0x7f5d9015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 --2- 172.21.15.12:0/2528043868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d7c003f80 0x7f5d90157c00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 >> 172.21.15.12:0/2528043868 conn(0x7f5d900b6240 msgr2=0x7f5d90161940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:04.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 shutdown_connections 2024-09-10T09:23:04.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.371+0000 7f5d9841e640 1 -- 172.21.15.12:0/2528043868 wait complete. 2024-09-10T09:23:04.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:04.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.484+0000 7fa627a77640 1 Processor -- start 2024-09-10T09:23:04.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.484+0000 7fa627a77640 1 -- start start 2024-09-10T09:23:04.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa627a77640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 0x7fa6200cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa627a77640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200d34d0 con 0x7fa6200b7aa0 2024-09-10T09:23:04.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa627a77640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200d3790 con 0x7fa6200b61f0 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa627a77640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa6200d3a70 con 0x7fa62015e860 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa626014640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa6200b7aa0 0x7fa6200b7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36662/0 (socket says 172.21.15.12:36662) 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa626014640 1 -- 172.21.15.12:0/3973392449 learned_addr learned my addr 172.21.15.12:0/3973392449 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa625813640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 0x7fa6200cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419642222 0 0) 0x7fa6200d34d0 con 0x7fa6200b7aa0 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.485+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa60c003520 con 0x7fa6200b7aa0 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 912134518 0 0) 0x7fa60c003520 con 0x7fa6200b7aa0 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 msgr2=0x7fa6200cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 0x7fa6200cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 >> v1:172.21.15.100:6789/0 conn(0x7fa6200b61f0 legacy=0x7fa6200b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200d3d50 con 0x7fa6200b7aa0 2024-09-10T09:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fa6180019f0 con 0x7fa6200b7aa0 2024-09-10T09:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 >> v1:172.21.15.12:6789/0 conn(0x7fa6200b7aa0 legacy=0x7fa6200b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa60c0039e0 0x7fa60c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c004390 0x7fa60c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 0x7fa60c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200d3a70 con 0x7fa60c0039e0 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c00b9c0 con 0x7fa60c004390 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c00bbc0 con 0x7fa62015e860 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625813640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa60c0039e0 0x7fa60c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa626014640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 0x7fa60c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625012640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c004390 0x7fa60c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625813640 1 -- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 msgr2=0x7fa60c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625813640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015e860 0x7fa60c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625813640 1 -- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c004390 msgr2=0x7fa60c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625813640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c004390 0x7fa60c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.486+0000 7fa625813640 1 -- 172.21.15.12:0/3973392449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c003520 con 0x7fa60c0039e0 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa625813640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa60c0039e0 0x7fa60c003dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009ac0 tx=0x7fa60c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0ba1f62d41cc81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c036070 con 0x7fa60c0039e0 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c031400 con 0x7fa60c0039e0 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa624811640 1 -- 172.21.15.12:0/3973392449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c009690 con 0x7fa60c0039e0 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa627a77640 1 -- 172.21.15.12:0/3973392449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa60c0039e0 msgr2=0x7fa60c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa627a77640 1 --2- 172.21.15.12:0/3973392449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa60c0039e0 0x7fa60c003dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009ac0 tx=0x7fa60c005830 comp rx=0 tx=0).stop 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.487+0000 7fa626014640 1 -- 172.21.15.12:0/3973392449 reap_dead start 2024-09-10T09:23:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.488+0000 7fa627a77640 1 -- 172.21.15.12:0/3973392449 shutdown_connections 2024-09-10T09:23:04.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.488+0000 7fa627a77640 1 -- 172.21.15.12:0/3973392449 >> 172.21.15.12:0/3973392449 conn(0x7fa620062c60 msgr2=0x7fa6200d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:04.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.488+0000 7fa627a77640 1 -- 172.21.15.12:0/3973392449 shutdown_connections 2024-09-10T09:23:04.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.488+0000 7fa627a77640 1 -- 172.21.15.12:0/3973392449 wait complete. 2024-09-10T09:23:04.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.489+0000 7fa627a77640 1 Processor -- start 2024-09-10T09:23:04.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.489+0000 7fa627a77640 1 -- start start 2024-09-10T09:23:04.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c0039e0 0x7fa62015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 0x7fa6200cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015c9c0 0x7fa62015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa62015ec40 con 0x7fa620152230 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200d4310 con 0x7fa60c0039e0 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa62015edc0 con 0x7fa62015c9c0 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 0x7fa6200cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 0x7fa6200cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43566/0 (socket says 172.21.15.12:43566) 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 -- 172.21.15.12:0/740280301 learned_addr learned my addr 172.21.15.12:0/740280301 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625813640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c0039e0 0x7fa62015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa626014640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015c9c0 0x7fa62015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 -- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015c9c0 msgr2=0x7fa62015ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015c9c0 0x7fa62015ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 -- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c0039e0 msgr2=0x7fa62015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c0039e0 0x7fa62015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 -- 172.21.15.12:0/740280301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200cbcf0 con 0x7fa620152230 2024-09-10T09:23:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa626014640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015c9c0 0x7fa62015ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa625012640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 0x7fa6200cb7b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa61000f770 tx=0x7fa61000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61000fe80 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa610018070 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6201526b0 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61000d730 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.490+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6200cc250 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.491+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6200b3ad0 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.492+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa61000d8d0 con 0x7fa620152230 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.492+0000 7fa6167fc640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa60406be30 0x7fa60406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.492+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa61008ad90 con 0x7fa620152230 2024-09-10T09:23:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.492+0000 7fa625813640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa60406be30 0x7fa60406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.493+0000 7fa625813640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa60406be30 0x7fa60406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009ac0 tx=0x7fa61c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.497+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6200cbcf0 con 0x7fa620152230 2024-09-10T09:23:04.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.672+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6200d2700 con 0x7fa620152230 2024-09-10T09:23:04.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.674+0000 7fa6167fc640 1 -- 172.21.15.12:0/740280301 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fa610059740 con 0x7fa620152230 2024-09-10T09:23:04.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:04.675 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:22:39.951363+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:22:36.152109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T09:22:37.271656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:04.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.675+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa60406be30 msgr2=0x7fa60406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.675+0000 7fa627a77640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa60406be30 0x7fa60406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009ac0 tx=0x7fa61c008030 comp rx=0 tx=0).stop 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.675+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 msgr2=0x7fa6200cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.675+0000 7fa627a77640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 0x7fa6200cb7b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa61000f770 tx=0x7fa61000fc30 comp rx=0 tx=0).stop 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 shutdown_connections 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa60406be30 0x7fa60406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa62015c9c0 0x7fa62015ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa620152230 0x7fa6200cb7b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 --2- 172.21.15.12:0/740280301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa60c0039e0 0x7fa62015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 >> 172.21.15.12:0/740280301 conn(0x7fa620062c60 msgr2=0x7fa6200cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 shutdown_connections 2024-09-10T09:23:04.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.676+0000 7fa627a77640 1 -- 172.21.15.12:0/740280301 wait complete. 2024-09-10T09:23:04.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T09:23:04.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.790+0000 7fad21f11640 1 Processor -- start 2024-09-10T09:23:04.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.790+0000 7fad21f11640 1 -- start start 2024-09-10T09:23:04.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad21f11640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad21f11640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fad1c15ed20 0x7fad1c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad21f11640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad1c0cef90 0x7fad1c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad21f11640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c0d1ae0 con 0x7fad1c0cef90 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad21f11640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c0b7170 con 0x7fad1c15ed20 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad21f11640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0b7aa0 con 0x7fad1c15e940 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad1c0cef90 0x7fad1c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad1c0cef90 0x7fad1c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43576/0 (socket says 172.21.15.12:43576) 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 -- 172.21.15.12:0/47339230 learned_addr learned my addr 172.21.15.12:0/47339230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1b7fe640 1 --2- 172.21.15.12:0/47339230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1affd640 1 --2- 172.21.15.12:0/47339230 >> v2:172.21.15.100:3300/0 conn(0x7fad1c15ed20 0x7fad1c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 -- 172.21.15.12:0/47339230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 msgr2=0x7fad1c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 --2- 172.21.15.12:0/47339230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 -- 172.21.15.12:0/47339230 >> v2:172.21.15.100:3300/0 conn(0x7fad1c15ed20 msgr2=0x7fad1c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.791+0000 7fad1bfff640 1 --2- 172.21.15.12:0/47339230 >> v2:172.21.15.100:3300/0 conn(0x7fad1c15ed20 0x7fad1c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.792+0000 7fad1bfff640 1 -- 172.21.15.12:0/47339230 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0d3660 con 0x7fad1c0cef90 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.792+0000 7fad1bfff640 1 --2- 172.21.15.12:0/47339230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b3220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0d5830 tx=0x7fad1402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7048f0764823e12d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.792+0000 7fad1a7fc640 1 -- 172.21.15.12:0/47339230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14036070 con 0x7fad1c0cef90 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.792+0000 7fad1a7fc640 1 -- 172.21.15.12:0/47339230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad14031600 con 0x7fad1c0cef90 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.792+0000 7fad1a7fc640 1 -- 172.21.15.12:0/47339230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140319d0 con 0x7fad1c0cef90 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 -- 172.21.15.12:0/47339230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c0cef90 msgr2=0x7fad1c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 --2- 172.21.15.12:0/47339230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b3220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0d5830 tx=0x7fad1402a730 comp rx=0 tx=0).stop 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 -- 172.21.15.12:0/47339230 shutdown_connections 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 --2- 172.21.15.12:0/47339230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b3220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 --2- 172.21.15.12:0/47339230 >> v2:172.21.15.100:3300/0 conn(0x7fad1c15ed20 0x7fad1c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 --2- 172.21.15.12:0/47339230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 -- 172.21.15.12:0/47339230 >> 172.21.15.12:0/47339230 conn(0x7fad1c0b6240 msgr2=0x7fad1c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 -- 172.21.15.12:0/47339230 shutdown_connections 2024-09-10T09:23:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.793+0000 7fad21f11640 1 -- 172.21.15.12:0/47339230 wait complete. 2024-09-10T09:23:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.794+0000 7fad21f11640 1 Processor -- start 2024-09-10T09:23:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.794+0000 7fad21f11640 1 -- start start 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad21f11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad21f11640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad21f11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 0x7fad1c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad21f11640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0d3f00 con 0x7fad1c15ed20 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad21f11640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0d3c20 con 0x7fad1c0cef90 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad21f11640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0d1ef0 con 0x7fad1c15e940 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 0x7fad1c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 0x7fad1c15adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43592/0 (socket says 172.21.15.12:43592) 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad1bfff640 1 -- 172.21.15.12:0/818211591 learned_addr learned my addr 172.21.15.12:0/818211591 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad1b7fe640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.795+0000 7fad1affd640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad1bfff640 1 -- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 msgr2=0x7fad1c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad1bfff640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad1bfff640 1 -- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0cef90 msgr2=0x7fad1c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad1bfff640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad1bfff640 1 -- 172.21.15.12:0/818211591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0cdc90 con 0x7fad1c15ed20 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad1bfff640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 0x7fad1c15adf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad14009f40 tx=0x7fad14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14036050 con 0x7fad1c15ed20 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad14042070 con 0x7fad1c15ed20 2024-09-10T09:23:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c0cdf70 con 0x7fad1c15ed20 2024-09-10T09:23:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14009510 con 0x7fad1c15ed20 2024-09-10T09:23:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.796+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c1487a0 con 0x7fad1c15ed20 2024-09-10T09:23:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.797+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c0d1060 con 0x7fad1c15ed20 2024-09-10T09:23:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.798+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad14007bf0 con 0x7fad1c15ed20 2024-09-10T09:23:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.798+0000 7fad03fff640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fad0806be60 0x7fad0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:04.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.798+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad140aba50 con 0x7fad1c15ed20 2024-09-10T09:23:04.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.798+0000 7fad1b7fe640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fad0806be60 0x7fad0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:04.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.799+0000 7fad1b7fe640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fad0806be60 0x7fad0806e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009ac0 tx=0x7fad0c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:04.802+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad14079db0 con 0x7fad1c15ed20 2024-09-10T09:23:05.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.013+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fad1c0ba6b0 con 0x7fad1c15ed20 2024-09-10T09:23:05.014 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-10T09:23:05.014+0000 7f66a0124640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:23:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.015+0000 7fad03fff640 1 -- 172.21.15.12:0/818211591 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fad1407e0b0 con 0x7fad1c15ed20 2024-09-10T09:23:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fad0806be60 msgr2=0x7fad0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fad0806be60 0x7fad0806e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009ac0 tx=0x7fad0c009190 comp rx=0 tx=0).stop 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 msgr2=0x7fad1c15adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 0x7fad1c15adf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad14009f40 tx=0x7fad14004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 shutdown_connections 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fad0806be60 0x7fad0806e320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1c15ed20 0x7fad1c15adf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad1c15e940 0x7fad1c0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 --2- 172.21.15.12:0/818211591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0cef90 0x7fad1c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 >> 172.21.15.12:0/818211591 conn(0x7fad1c0b6240 msgr2=0x7fad1c0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:05.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 shutdown_connections 2024-09-10T09:23:05.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.018+0000 7fad21f11640 1 -- 172.21.15.12:0/818211591 wait complete. 2024-09-10T09:23:05.024 INFO:tasks.ceph.mds.d.smithi100.stderr: -6513> 2024-09-10T09:22:43.910+0000 7fbd77ecf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T09:23:05.030 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T09:23:05.059 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-09-10T09:23:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.134+0000 7feb1741e640 1 Processor -- start 2024-09-10T09:23:05.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 -- start start 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb1015e960 0x7feb1006bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb100cb2f0 0x7feb1006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb1006c9f0 0x7feb100d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7feb100b7a40 con 0x7feb1006c9f0 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7feb100d4040 con 0x7feb1015e960 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.135+0000 7feb1741e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feb100cf750 con 0x7feb100cb2f0 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb1006c9f0 0x7feb100d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb1006c9f0 0x7feb100d22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43600/0 (socket says 172.21.15.12:43600) 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 -- 172.21.15.12:0/1962606485 learned_addr learned my addr 172.21.15.12:0/1962606485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb151ba640 1 --2- 172.21.15.12:0/1962606485 >> v2:172.21.15.100:3300/0 conn(0x7feb1015e960 0x7feb1006bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb149b9640 1 --2- 172.21.15.12:0/1962606485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb100cb2f0 0x7feb1006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 -- 172.21.15.12:0/1962606485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb100cb2f0 msgr2=0x7feb1006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 --2- 172.21.15.12:0/1962606485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb100cb2f0 0x7feb1006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 -- 172.21.15.12:0/1962606485 >> v2:172.21.15.100:3300/0 conn(0x7feb1015e960 msgr2=0x7feb1006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 --2- 172.21.15.12:0/1962606485 >> v2:172.21.15.100:3300/0 conn(0x7feb1015e960 0x7feb1006bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb159bb640 1 -- 172.21.15.12:0/1962606485 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100cfa30 con 0x7feb1006c9f0 2024-09-10T09:23:05.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.136+0000 7feb151ba640 1 --2- 172.21.15.12:0/1962606485 >> v2:172.21.15.100:3300/0 conn(0x7feb1015e960 0x7feb1006bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:05.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb159bb640 1 --2- 172.21.15.12:0/1962606485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb100d22b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb100638c0 tx=0x7feb0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cb4055ccae0cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:05.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb07fff640 1 -- 172.21.15.12:0/1962606485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08036070 con 0x7feb1006c9f0 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb07fff640 1 -- 172.21.15.12:0/1962606485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb08031600 con 0x7feb1006c9f0 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb07fff640 1 -- 172.21.15.12:0/1962606485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb080319d0 con 0x7feb1006c9f0 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 -- 172.21.15.12:0/1962606485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 msgr2=0x7feb100d22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 --2- 172.21.15.12:0/1962606485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb100d22b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb100638c0 tx=0x7feb0802a6a0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 -- 172.21.15.12:0/1962606485 shutdown_connections 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 --2- 172.21.15.12:0/1962606485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb100d22b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 --2- 172.21.15.12:0/1962606485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb100cb2f0 0x7feb1006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 --2- 172.21.15.12:0/1962606485 >> v2:172.21.15.100:3300/0 conn(0x7feb1015e960 0x7feb1006bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 -- 172.21.15.12:0/1962606485 >> 172.21.15.12:0/1962606485 conn(0x7feb100d46e0 msgr2=0x7feb100d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 -- 172.21.15.12:0/1962606485 shutdown_connections 2024-09-10T09:23:05.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.137+0000 7feb1741e640 1 -- 172.21.15.12:0/1962606485 wait complete. 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 Processor -- start 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 -- start start 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb1014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb100cb2f0 0x7feb101574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb1015e960 0x7feb1015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feb100d27f0 con 0x7feb1006c9f0 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb100d3cd0 con 0x7feb100cb2f0 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb1741e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feb100d2970 con 0x7feb1015e960 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb151ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb1014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb151ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb1014b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43604/0 (socket says 172.21.15.12:43604) 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb151ba640 1 -- 172.21.15.12:0/1899306319 learned_addr learned my addr 172.21.15.12:0/1899306319 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.139+0000 7feb149b9640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb100cb2f0 0x7feb101574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb159bb640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb1015e960 0x7feb1015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb151ba640 1 -- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb1015e960 msgr2=0x7feb1015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb151ba640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb1015e960 0x7feb1015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb151ba640 1 -- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb100cb2f0 msgr2=0x7feb101574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb151ba640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb100cb2f0 0x7feb101574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb151ba640 1 -- 172.21.15.12:0/1899306319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1015b6e0 con 0x7feb1006c9f0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb151ba640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb1014b250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c7f0 tx=0x7feb0c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c015070 con 0x7feb1006c9f0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb0c007820 con 0x7feb1006c9f0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1014b790 con 0x7feb1006c9f0 2024-09-10T09:23:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c007bd0 con 0x7feb1006c9f0 2024-09-10T09:23:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.140+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1015ac00 con 0x7feb1006c9f0 2024-09-10T09:23:05.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.141+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb100d22b0 con 0x7feb1006c9f0 2024-09-10T09:23:05.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.142+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb0c018070 con 0x7feb1006c9f0 2024-09-10T09:23:05.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.142+0000 7feb05ffb640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feaf406be60 0x7feaf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.142+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7feb0c08ae60 con 0x7feb1006c9f0 2024-09-10T09:23:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.142+0000 7feb149b9640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feaf406be60 0x7feaf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.143+0000 7feb149b9640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feaf406be60 0x7feaf406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb101582c0 tx=0x7feb00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.147+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb1014b790 con 0x7feb1006c9f0 2024-09-10T09:23:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:05.361+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feb1015c490 con 0x7feb1006c9f0 2024-09-10T09:23:06.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.035+0000 7feb05ffb640 1 -- 172.21.15.12:0/1899306319 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7feb1015b6e0 con 0x7feb1006c9f0 2024-09-10T09:23:06.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.037+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feaf406be60 msgr2=0x7feaf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:06.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.037+0000 7feb1741e640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feaf406be60 0x7feaf406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb101582c0 tx=0x7feb00008040 comp rx=0 tx=0).stop 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.037+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 msgr2=0x7feb1014b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.037+0000 7feb1741e640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb1014b250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c7f0 tx=0x7feb0c00ccb0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 shutdown_connections 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7feaf406be60 0x7feaf406e320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb1015e960 0x7feb1015cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb100cb2f0 0x7feb101574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 --2- 172.21.15.12:0/1899306319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb1006c9f0 0x7feb1014b250 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 >> 172.21.15.12:0/1899306319 conn(0x7feb100d46e0 msgr2=0x7feb100b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 shutdown_connections 2024-09-10T09:23:06.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.038+0000 7feb1741e640 1 -- 172.21.15.12:0/1899306319 wait complete. 2024-09-10T09:23:06.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T09:23:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.166+0000 7f205b181640 1 Processor -- start 2024-09-10T09:23:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.166+0000 7f205b181640 1 -- start start 2024-09-10T09:23:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f205b181640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20540b61e0 0x7f20540b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f205b181640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f20540b3b00 0x7f20541625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f205b181640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20540b6b00 con 0x7f20540b3540 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f205b181640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f20540d24f0 con 0x7f20540b61e0 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f205b181640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f20540d20e0 con 0x7f20540b3b00 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f2058f1d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20540b61e0 0x7f20540b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f2058f1d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20540b61e0 0x7f20540b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43614/0 (socket says 172.21.15.12:43614) 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.167+0000 7f2058f1d640 1 -- 172.21.15.12:0/3612517199 learned_addr learned my addr 172.21.15.12:0/3612517199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.168+0000 7f2053fff640 1 --2- 172.21.15.12:0/3612517199 >> v2:172.21.15.100:3300/0 conn(0x7f20540b3b00 0x7f20541625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.168+0000 7f2058f1d640 1 -- 172.21.15.12:0/3612517199 >> v2:172.21.15.100:3300/0 conn(0x7f20540b3b00 msgr2=0x7f20541625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.168+0000 7f2058f1d640 1 --2- 172.21.15.12:0/3612517199 >> v2:172.21.15.100:3300/0 conn(0x7f20540b3b00 0x7f20541625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.168+0000 7f2058f1d640 1 -- 172.21.15.12:0/3612517199 >> v1:172.21.15.100:6789/0 conn(0x7f20540b3540 legacy=0x7f2054162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:06.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.168+0000 7f2058f1d640 1 -- 172.21.15.12:0/3612517199 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540cfa70 con 0x7f20540b61e0 2024-09-10T09:23:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.168+0000 7f2058f1d640 1 --2- 172.21.15.12:0/3612517199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b61e0 0x7f20540b65c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2054163690 tx=0x7f204402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66d9d9b93598de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f20537fe640 1 -- 172.21.15.12:0/3612517199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044037070 con 0x7f20540b61e0 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f20537fe640 1 -- 172.21.15.12:0/3612517199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044032440 con 0x7f20540b61e0 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f20537fe640 1 -- 172.21.15.12:0/3612517199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044032810 con 0x7f20540b61e0 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 -- 172.21.15.12:0/3612517199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b61e0 msgr2=0x7f20540b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 --2- 172.21.15.12:0/3612517199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b61e0 0x7f20540b65c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2054163690 tx=0x7f204402a150 comp rx=0 tx=0).stop 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 -- 172.21.15.12:0/3612517199 shutdown_connections 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 --2- 172.21.15.12:0/3612517199 >> v2:172.21.15.100:3300/0 conn(0x7f20540b3b00 0x7f20541625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 --2- 172.21.15.12:0/3612517199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b61e0 0x7f20540b65c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 -- 172.21.15.12:0/3612517199 >> 172.21.15.12:0/3612517199 conn(0x7f20540d11e0 msgr2=0x7f20540d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 -- 172.21.15.12:0/3612517199 shutdown_connections 2024-09-10T09:23:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.169+0000 7f205b181640 1 -- 172.21.15.12:0/3612517199 wait complete. 2024-09-10T09:23:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.170+0000 7f205b181640 1 Processor -- start 2024-09-10T09:23:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.171+0000 7f205b181640 1 -- start start 2024-09-10T09:23:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.171+0000 7f205b181640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 0x7f2054154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.171+0000 7f205b181640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20540b3b00 0x7f2054160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.171+0000 7f205b181640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20540b61e0 0x7f20541f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.171+0000 7f205b181640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f205415edc0 con 0x7f20540b3540 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f205b181640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20540d0030 con 0x7f20540b3b00 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f205b181640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2054162180 con 0x7f20540b61e0 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 0x7f2054154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 0x7f2054154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43616/0 (socket says 172.21.15.12:43616) 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 -- 172.21.15.12:0/4285966790 learned_addr learned my addr 172.21.15.12:0/4285966790 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2053fff640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20540b3b00 0x7f2054160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f205971e640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20540b61e0 0x7f20541f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 -- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20540b61e0 msgr2=0x7f20541f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20540b61e0 0x7f20541f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 -- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20540b3b00 msgr2=0x7f2054160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20540b3b00 0x7f2054160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:06.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 -- 172.21.15.12:0/4285966790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20541610e0 con 0x7f20540b3540 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2053fff640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20540b3b00 0x7f2054160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f2058f1d640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 0x7f2054154770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f204402a190 tx=0x7f20440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044041020 con 0x7f20540b3540 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20440306c0 con 0x7f20540b3540 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20541613c0 con 0x7f20540b3540 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044037040 con 0x7f20540b3540 2024-09-10T09:23:06.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.172+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054161980 con 0x7f20540b3540 2024-09-10T09:23:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.173+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20540d1d00 con 0x7f20540b3540 2024-09-10T09:23:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.174+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2044044020 con 0x7f20540b3540 2024-09-10T09:23:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.174+0000 7f20517fa640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f204006be30 0x7f204006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.174+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f20440ab700 con 0x7f20540b3540 2024-09-10T09:23:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.175+0000 7f2053fff640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f204006be30 0x7f204006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.175+0000 7f2053fff640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f204006be30 0x7f204006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2048006fd0 tx=0x7f2048008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:06.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.179+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f204404b030 con 0x7f20540b3540 2024-09-10T09:23:06.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:06.357+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20540ba6e0 con 0x7f20540b3540 2024-09-10T09:23:07.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.036+0000 7f20517fa640 1 -- 172.21.15.12:0/4285966790 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f204407a050 con 0x7f20540b3540 2024-09-10T09:23:07.037 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-10T09:23:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.039+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f204006be30 msgr2=0x7f204006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f204006be30 0x7f204006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2048006fd0 tx=0x7f2048008040 comp rx=0 tx=0).stop 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 msgr2=0x7f2054154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 0x7f2054154770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f204402a190 tx=0x7f20440046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 shutdown_connections 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f204006be30 0x7f204006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20540b61e0 0x7f20541f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20540b3b00 0x7f2054160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 --2- 172.21.15.12:0/4285966790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20540b3540 0x7f2054154770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 >> 172.21.15.12:0/4285966790 conn(0x7f20540d11e0 msgr2=0x7f20540b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 shutdown_connections 2024-09-10T09:23:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.040+0000 7f205b181640 1 -- 172.21.15.12:0/4285966790 wait complete. 2024-09-10T09:23:07.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T09:23:07.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.163+0000 7f9be782e640 1 Processor -- start 2024-09-10T09:23:07.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.163+0000 7f9be782e640 1 -- start start 2024-09-10T09:23:07.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be782e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9be00d1990 0x7f9be0070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be782e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b5590 0x7f9be00b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be782e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9be00b7370 0x7f9be0073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be782e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9be00d2320 con 0x7f9be00b7370 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be782e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9be0162260 con 0x7f9be00d1990 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be782e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9be0162540 con 0x7f9be00b5590 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be5dcb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9be00b7370 0x7f9be0073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be5dcb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9be00b7370 0x7f9be0073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43630/0 (socket says 172.21.15.12:43630) 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be5dcb640 1 -- 172.21.15.12:0/4037305397 learned_addr learned my addr 172.21.15.12:0/4037305397 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be4dc9640 1 --2- 172.21.15.12:0/4037305397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b5590 0x7f9be00b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.164+0000 7f9be55ca640 1 --2- 172.21.15.12:0/4037305397 >> v2:172.21.15.100:3300/0 conn(0x7f9be00d1990 0x7f9be0070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be5dcb640 1 -- 172.21.15.12:0/4037305397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b5590 msgr2=0x7f9be00b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be5dcb640 1 --2- 172.21.15.12:0/4037305397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b5590 0x7f9be00b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be5dcb640 1 -- 172.21.15.12:0/4037305397 >> v2:172.21.15.100:3300/0 conn(0x7f9be00d1990 msgr2=0x7f9be0070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:07.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be5dcb640 1 --2- 172.21.15.12:0/4037305397 >> v2:172.21.15.100:3300/0 conn(0x7f9be00d1990 0x7f9be0070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be5dcb640 1 -- 172.21.15.12:0/4037305397 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be0162820 con 0x7f9be00b7370 2024-09-10T09:23:07.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be55ca640 1 --2- 172.21.15.12:0/4037305397 >> v2:172.21.15.100:3300/0 conn(0x7f9be00d1990 0x7f9be0070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9be5dcb640 1 --2- 172.21.15.12:0/4037305397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00b7370 0x7f9be0073150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9be0074190 tx=0x7f9bd002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306f5cdefcb7aa71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.165+0000 7f9bdffff640 1 -- 172.21.15.12:0/4037305397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0036070 con 0x7f9be00b7370 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9bdffff640 1 -- 172.21.15.12:0/4037305397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0031600 con 0x7f9be00b7370 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9bdffff640 1 -- 172.21.15.12:0/4037305397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00319d0 con 0x7f9be00b7370 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 -- 172.21.15.12:0/4037305397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00b7370 msgr2=0x7f9be0073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 --2- 172.21.15.12:0/4037305397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00b7370 0x7f9be0073150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9be0074190 tx=0x7f9bd002a610 comp rx=0 tx=0).stop 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 -- 172.21.15.12:0/4037305397 shutdown_connections 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 --2- 172.21.15.12:0/4037305397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00b7370 0x7f9be0073150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 --2- 172.21.15.12:0/4037305397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b5590 0x7f9be00b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 --2- 172.21.15.12:0/4037305397 >> v2:172.21.15.100:3300/0 conn(0x7f9be00d1990 0x7f9be0070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 -- 172.21.15.12:0/4037305397 >> 172.21.15.12:0/4037305397 conn(0x7f9be006f390 msgr2=0x7f9be006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:07.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 -- 172.21.15.12:0/4037305397 shutdown_connections 2024-09-10T09:23:07.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.166+0000 7f9be782e640 1 -- 172.21.15.12:0/4037305397 wait complete. 2024-09-10T09:23:07.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.167+0000 7f9be782e640 1 Processor -- start 2024-09-10T09:23:07.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.167+0000 7f9be782e640 1 -- start start 2024-09-10T09:23:07.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be782e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00b5590 0x7f9be01615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be782e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b7370 0x7f9be0153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be782e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 0x7f9be0155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be782e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9be00d1d70 con 0x7f9be00d1990 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be782e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9be0162de0 con 0x7f9be00b5590 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be782e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9be00b77e0 con 0x7f9be00b7370 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be5dcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 0x7f9be0155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be5dcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 0x7f9be0155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43638/0 (socket says 172.21.15.12:43638) 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be5dcb640 1 -- 172.21.15.12:0/407645411 learned_addr learned my addr 172.21.15.12:0/407645411 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be55ca640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00b5590 0x7f9be01615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.168+0000 7f9be4dc9640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b7370 0x7f9be0153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be5dcb640 1 -- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b7370 msgr2=0x7f9be0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:07.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be5dcb640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b7370 0x7f9be0153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be5dcb640 1 -- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00b5590 msgr2=0x7f9be01615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be5dcb640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00b5590 0x7f9be01615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be5dcb640 1 -- 172.21.15.12:0/407645411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be0161b30 con 0x7f9be00d1990 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be4dc9640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b7370 0x7f9be0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be5dcb640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 0x7f9be0155940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009f40 tx=0x7f9bd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0036050 con 0x7f9be00d1990 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0042070 con 0x7f9be00d1990 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0009510 con 0x7f9be00d1990 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be015f7b0 con 0x7f9be00d1990 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.169+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be015fd70 con 0x7f9be00d1990 2024-09-10T09:23:07.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.170+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be00b6e30 con 0x7f9be00d1990 2024-09-10T09:23:07.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.171+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bd0007bd0 con 0x7f9be00d1990 2024-09-10T09:23:07.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.171+0000 7f9bddffb640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9bcc06be60 0x7f9bcc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:07.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.171+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f9bd00aba70 con 0x7f9be00d1990 2024-09-10T09:23:07.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.171+0000 7f9be55ca640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9bcc06be60 0x7f9bcc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:07.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.172+0000 7f9be55ca640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9bcc06be60 0x7f9bcc06e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800aae0 tx=0x7f9bd8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:07.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.175+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bd007a610 con 0x7f9be00d1990 2024-09-10T09:23:07.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:07.352+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9be0161ea0 con 0x7f9be00d1990 2024-09-10T09:23:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.049+0000 7f9bddffb640 1 -- 172.21.15.12:0/407645411 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f9bd0079f10 con 0x7f9be00d1990 2024-09-10T09:23:08.050 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.052+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9bcc06be60 msgr2=0x7f9bcc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.052+0000 7f9be782e640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9bcc06be60 0x7f9bcc06e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800aae0 tx=0x7f9bd8008040 comp rx=0 tx=0).stop 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 msgr2=0x7f9be0155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 0x7f9be0155940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009f40 tx=0x7f9bd0004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 shutdown_connections 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9bcc06be60 0x7f9bcc06e320 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800aae0 tx=0x7f9bd8008040 comp rx=0 tx=0).stop 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9be00d1990 0x7f9be0155940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9be00b7370 0x7f9be0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 --2- 172.21.15.12:0/407645411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9be00b5590 0x7f9be01615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 >> 172.21.15.12:0/407645411 conn(0x7f9be006f390 msgr2=0x7f9be00706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.053+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 shutdown_connections 2024-09-10T09:23:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.054+0000 7f9be782e640 1 -- 172.21.15.12:0/407645411 wait complete. 2024-09-10T09:23:08.070 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T09:23:08.070 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T09:23:08.070 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T09:23:08.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:23:08.071 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T09:23:08.071 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T09:23:08.071 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T09:23:08.071 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:23:08.071 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T09:23:08.071 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T09:23:08.072 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T09:23:08.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:23:08.072 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T09:23:08.072 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T09:23:08.072 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T09:23:08.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:23:08.082 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T09:23:08.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T09:23:08.083 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T09:23:08.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T09:23:08.084 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T09:23:08.084 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T09:23:08.085 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T09:23:08.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T09:23:08.125 INFO:tasks.ceph.mds.a:Started 2024-09-10T09:23:08.126 DEBUG:teuthology.parallel:result is None 2024-09-10T09:23:08.126 INFO:tasks.ceph.mds.c:Started 2024-09-10T09:23:08.126 DEBUG:teuthology.parallel:result is None 2024-09-10T09:23:08.127 INFO:tasks.ceph.mds.b:Started 2024-09-10T09:23:08.127 INFO:tasks.ceph.mds.d:Started 2024-09-10T09:23:08.128 DEBUG:teuthology.parallel:result is None 2024-09-10T09:23:08.128 DEBUG:teuthology.parallel:result is None 2024-09-10T09:23:08.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T09:23:08.209 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2024-09-10T09:23:08.209 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-09-10T09:23:08.209 INFO:tasks.ceph.mds.b.smithi100.stderr:2024-09-10T09:23:08.208+0000 7fc678946640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T09:23:08.210 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-09-10T09:23:08.211 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-10T09:23:08.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.242+0000 7f0428c5c640 1 Processor -- start 2024-09-10T09:23:08.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.242+0000 7f0428c5c640 1 -- start start 2024-09-10T09:23:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f0428c5c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04240b8f90 0x7f04240b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f0428c5c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04240b7170 con 0x7f042415ed20 2024-09-10T09:23:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f0428c5c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04240b7aa0 con 0x7f042415e940 2024-09-10T09:23:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f0428c5c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f04240d3660 con 0x7f04240b8f90 2024-09-10T09:23:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f041bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f042415ed20 0x7f04240b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36672/0 (socket says 172.21.15.12:36672) 2024-09-10T09:23:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f041bfff640 1 -- 172.21.15.12:0/1266448228 learned_addr learned my addr 172.21.15.12:0/1266448228 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:08.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.243+0000 7f0422d9d640 1 --2- 172.21.15.12:0/1266448228 >> v2:172.21.15.12:3300/0 conn(0x7f04240b8f90 0x7f04240b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:08.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0421d9b640 1 -- 172.21.15.12:0/1266448228 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532637719 0 0) 0x7f04240b7aa0 con 0x7f042415e940 2024-09-10T09:23:08.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0421d9b640 1 -- 172.21.15.12:0/1266448228 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0410003520 con 0x7f042415e940 2024-09-10T09:23:08.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0421d9b640 1 -- 172.21.15.12:0/1266448228 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957568171 0 0) 0x7f040c001110 con 0x7f042415ed20 2024-09-10T09:23:08.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0422d9d640 1 -- 172.21.15.12:0/1266448228 >> v1:172.21.15.100:6789/0 conn(0x7f042415e940 legacy=0x7f04240d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0422d9d640 1 -- 172.21.15.12:0/1266448228 >> v1:172.21.15.12:6789/0 conn(0x7f042415ed20 legacy=0x7f04240b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0422d9d640 1 -- 172.21.15.12:0/1266448228 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240d3940 con 0x7f04240b8f90 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.244+0000 7f0422d9d640 1 --2- 172.21.15.12:0/1266448228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04240b3930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f041c009d90 tx=0x7f041c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44aaf219534e1342 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0421d9b640 1 -- 172.21.15.12:0/1266448228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c037070 con 0x7f04240b8f90 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0421d9b640 1 -- 172.21.15.12:0/1266448228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c007740 con 0x7f04240b8f90 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0421d9b640 1 -- 172.21.15.12:0/1266448228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c007af0 con 0x7f04240b8f90 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 -- 172.21.15.12:0/1266448228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 msgr2=0x7f04240b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1266448228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04240b3930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f041c009d90 tx=0x7f041c02a780 comp rx=0 tx=0).stop 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 -- 172.21.15.12:0/1266448228 shutdown_connections 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1266448228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04240b3930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 -- 172.21.15.12:0/1266448228 >> 172.21.15.12:0/1266448228 conn(0x7f04240b6240 msgr2=0x7f04240b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 -- 172.21.15.12:0/1266448228 shutdown_connections 2024-09-10T09:23:08.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.245+0000 7f0428c5c640 1 -- 172.21.15.12:0/1266448228 wait complete. 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 Processor -- start 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 -- start start 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04241f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042415e940 0x7f042414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042415ed20 0x7f0424160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f04240d3310 con 0x7f04240b8f90 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04240d3f00 con 0x7f042415ed20 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.247+0000 7f0428c5c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f04240d1ef0 con 0x7f042415e940 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04241f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04241f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43680/0 (socket says 172.21.15.12:43680) 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 -- 172.21.15.12:0/1681038163 learned_addr learned my addr 172.21.15.12:0/1681038163 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f0422d9d640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042415ed20 0x7f0424160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:08.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f041bfff640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042415e940 0x7f042414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 -- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042415e940 msgr2=0x7f042414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042415e940 0x7f042414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 -- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042415ed20 msgr2=0x7f0424160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042415ed20 0x7f0424160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 -- 172.21.15.12:0/1681038163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042415c5b0 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f0422d9d640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042415ed20 0x7f0424160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f042259c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04241f4610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f041400c4c0 tx=0x7f041400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04140052d0 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414005470 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.248+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414012870 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.249+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04240c9ab0 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.249+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042414f040 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.250+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04240cef90 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.250+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0414012a10 con 0x7f04240b8f90 2024-09-10T09:23:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.251+0000 7f041affd640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.251+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f041408a6a0 con 0x7f04240b8f90 2024-09-10T09:23:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.251+0000 7f041bfff640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.251+0000 7f041bfff640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f040406be30 0x7f040406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04240b6800 tx=0x7f040c007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.255+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0414058d00 con 0x7f04240b8f90 2024-09-10T09:23:08.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:08.443+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f04240ba6b0 con 0x7f04240b8f90 2024-09-10T09:23:09.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.058+0000 7f041affd640 1 -- 172.21.15.12:0/1681038163 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f041405d000 con 0x7f04240b8f90 2024-09-10T09:23:09.059 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f040406be30 msgr2=0x7f040406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f040406be30 0x7f040406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04240b6800 tx=0x7f040c007e40 comp rx=0 tx=0).stop 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 msgr2=0x7f04241f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04241f4610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f041400c4c0 tx=0x7f041400c980 comp rx=0 tx=0).stop 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 shutdown_connections 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042415ed20 0x7f0424160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042415e940 0x7f042414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 --2- 172.21.15.12:0/1681038163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240b8f90 0x7f04241f4610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 >> 172.21.15.12:0/1681038163 conn(0x7f04240b6240 msgr2=0x7f042415fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:09.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 shutdown_connections 2024-09-10T09:23:09.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.061+0000 7f0428c5c640 1 -- 172.21.15.12:0/1681038163 wait complete. 2024-09-10T09:23:09.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T09:23:09.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.182+0000 7f900882e640 1 Processor -- start 2024-09-10T09:23:09.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.182+0000 7f900882e640 1 -- start start 2024-09-10T09:23:09.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f900882e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f900415ed20 0x7f90040b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f900882e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90040b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f900882e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90040b7170 con 0x7f900415e940 2024-09-10T09:23:09.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f900882e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f90040b7aa0 con 0x7f900415ed20 2024-09-10T09:23:09.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f900882e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f90040d3660 con 0x7f90040cef90 2024-09-10T09:23:09.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f9001d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f900415ed20 0x7f90040b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f9001d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f900415ed20 0x7f90040b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43686/0 (socket says 172.21.15.12:43686) 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f9001d9b640 1 -- 172.21.15.12:0/3627025303 learned_addr learned my addr 172.21.15.12:0/3627025303 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f9002d9d640 1 --2- 172.21.15.12:0/3627025303 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90040b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.183+0000 7f9001d9b640 1 -- 172.21.15.12:0/3627025303 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 msgr2=0x7f90040b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f9001d9b640 1 --2- 172.21.15.12:0/3627025303 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90040b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f9001d9b640 1 -- 172.21.15.12:0/3627025303 >> v1:172.21.15.100:6789/0 conn(0x7f900415e940 legacy=0x7f90040d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f9001d9b640 1 -- 172.21.15.12:0/3627025303 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90040d3940 con 0x7f900415ed20 2024-09-10T09:23:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f9001d9b640 1 --2- 172.21.15.12:0/3627025303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415ed20 0x7f90040b3220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009870 tx=0x7f8ff802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987943c520be0f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f900159a640 1 -- 172.21.15.12:0/3627025303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8037070 con 0x7f900415ed20 2024-09-10T09:23:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f900159a640 1 -- 172.21.15.12:0/3627025303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff802ae50 con 0x7f900415ed20 2024-09-10T09:23:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.184+0000 7f900159a640 1 -- 172.21.15.12:0/3627025303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8032860 con 0x7f900415ed20 2024-09-10T09:23:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 -- 172.21.15.12:0/3627025303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415ed20 msgr2=0x7f90040b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 --2- 172.21.15.12:0/3627025303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415ed20 0x7f90040b3220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009870 tx=0x7f8ff802a300 comp rx=0 tx=0).stop 2024-09-10T09:23:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 -- 172.21.15.12:0/3627025303 shutdown_connections 2024-09-10T09:23:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 --2- 172.21.15.12:0/3627025303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415ed20 0x7f90040b3220 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 --2- 172.21.15.12:0/3627025303 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90040b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 -- 172.21.15.12:0/3627025303 >> 172.21.15.12:0/3627025303 conn(0x7f90040b6240 msgr2=0x7f90040b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 -- 172.21.15.12:0/3627025303 shutdown_connections 2024-09-10T09:23:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.185+0000 7f900882e640 1 -- 172.21.15.12:0/3627025303 wait complete. 2024-09-10T09:23:09.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.186+0000 7f900882e640 1 Processor -- start 2024-09-10T09:23:09.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.186+0000 7f900882e640 1 -- start start 2024-09-10T09:23:09.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900882e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90041f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900882e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 0x7f90040ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900882e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415ed20 0x7f900415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900882e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90040d3310 con 0x7f900415e940 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900882e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90040d3f00 con 0x7f900415ed20 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900882e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f90040d1ef0 con 0x7f90040cef90 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f9001d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 0x7f90040ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f9001d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 0x7f90040ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43694/0 (socket says 172.21.15.12:43694) 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f9001d9b640 1 -- 172.21.15.12:0/2419784141 learned_addr learned my addr 172.21.15.12:0/2419784141 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f900259c640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90041f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.187+0000 7f9002d9d640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415ed20 0x7f900415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f9001d9b640 1 -- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 msgr2=0x7f90041f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f9001d9b640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90041f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f9001d9b640 1 -- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415ed20 msgr2=0x7f900415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f9001d9b640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415ed20 0x7f900415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f9001d9b640 1 -- 172.21.15.12:0/2419784141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004158dc0 con 0x7f900415e940 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f9001d9b640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 0x7f90040ab1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8041070 con 0x7f900415e940 2024-09-10T09:23:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff803c670 con 0x7f900415e940 2024-09-10T09:23:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90041590a0 con 0x7f900415e940 2024-09-10T09:23:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8037040 con 0x7f900415e940 2024-09-10T09:23:09.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.188+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9004159660 con 0x7f900415e940 2024-09-10T09:23:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.189+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90040d1060 con 0x7f900415e940 2024-09-10T09:23:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.190+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ff8044070 con 0x7f900415e940 2024-09-10T09:23:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.190+0000 7f8ff2ffd640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fe406be30 0x7f8fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.190+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f8ff80ab1c0 con 0x7f900415e940 2024-09-10T09:23:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.190+0000 7f900259c640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fe406be30 0x7f8fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.191+0000 7f900259c640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fe406be30 0x7f8fe406e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001780 tx=0x7f8ff4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.194+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ff80797f0 con 0x7f900415e940 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.440+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f90040ba6b0 con 0x7f900415e940 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.440+0000 7f8ff2ffd640 1 -- 172.21.15.12:0/2419784141 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f8ff807daf0 con 0x7f900415e940 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+BmbzP+CBAAwak4MxQPq//XWl/jLP9zdQ==", 2024-09-10T09:23:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+BmkRHXFBAA00HqjesWmBbqObkCLgZixQ==", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+BmQmkxEBAAfzlx/8S+yTQfvDPfGjk6pg==", 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2024-09-10T09:23:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+Bm/v/mGxAANPFme0NigpsmBVgiaQEFSQ==", 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCkD+BmR/r6ABAA1/xgy4Vy1T+z8FVxcTW5OQ==", 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCnD+BmQlEZEhAAyLfKByWZBO31IwH/4ove9g==", 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCqD+BmsUkjFRAA73ge9siUqUMYAeWB8Wk90Q==", 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2024-09-10T09:23:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCtD+Bm7cXiJhAAuNPoe8s/rQR1SojOEwMb3g==", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQC0D+Bm6ZsIFBAAQNOiE4aQOGYQdOnv55mWXw==", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQC4D+Bmea6BFRAA6NvO7D29CtZ6jyAjhHXpTg==", 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2024-09-10T09:23:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQC8D+Bm30+WFxAArKJ2nwI5SWf75VkgtN6B3A==", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDAD+Bm/RNdChAAYTGmbK71EwKrQvWuZN8k3w==", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+BmiuoDIBAAv4A7F5XnNMKzCjr+tB2NaA==", 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-10T09:23:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+Bm1IbvKBAA3YNX6Y21e1Rt5ciJxLsKug==", 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+Bmz0u/JRAAazoLOWSwIjBlUsL9BdRWwA==", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+BmfcCfLhAASaSS2dFRjnpYqgEilyVZtg==", 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCfD+BmgNmEJhAAkt7A9EIBDmjatBS17VPWjg==", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mds", 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDHD+BmQTxNBBAAhB2lfAgg+6AAik3LpdHm4w==", 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDHD+BmEkVNBBAAFK9CUnk4U4mXPAZ0jx5bew==", 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T09:23:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-osd", 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDHD+BmEE5NBBAA/Nv1fbHfSGZBh1PN/ANBpQ==", 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDHD+Bm1FVNBBAAvNdnRxPr00v8rJaH/UB9kA==", 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDHD+BmrF1NBBAAuKE5z9+LRAWbrAz2RWiyuQ==", 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDHD+BmwmVNBBAACvtTkLrmjTtM5LP87FGRvQ==", 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgD+Bm9X+pBRAABdODK09DNuIDOPpdTzevWw==", 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCfD+BmI1lmOxAAC7zRxOowhi+zudMvum5fGQ==", 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-10T09:23:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-10T09:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-09-10T09:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-10T09:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:09.458 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fe406be30 msgr2=0x7f8fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fe406be30 0x7f8fe406e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001780 tx=0x7f8ff4009040 comp rx=0 tx=0).stop 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 msgr2=0x7f90040ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 0x7f90040ab1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff80046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 shutdown_connections 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8fe406be30 0x7f8fe406e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415ed20 0x7f900415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f900415e940 0x7f90040ab1a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 --2- 172.21.15.12:0/2419784141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90040cef90 0x7f90041f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 >> 172.21.15.12:0/2419784141 conn(0x7f90040b6240 msgr2=0x7f9004160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:09.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 shutdown_connections 2024-09-10T09:23:09.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.442+0000 7f900882e640 1 -- 172.21.15.12:0/2419784141 wait complete. 2024-09-10T09:23:09.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T09:23:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.563+0000 7f671dac9640 1 Processor -- start 2024-09-10T09:23:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f671dac9640 1 -- start start 2024-09-10T09:23:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f671dac9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f671815e940 0x7f67180d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f671dac9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67180cef90 0x7f67180d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f671dac9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67180b7170 con 0x7f671815ed20 2024-09-10T09:23:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f671dac9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f67180d1ae0 con 0x7f67180cef90 2024-09-10T09:23:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f671dac9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f67180b7aa0 con 0x7f671815e940 2024-09-10T09:23:09.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f6717fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67180cef90 0x7f67180d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.564+0000 7f6716ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f671815ed20 0x7f67180b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36686/0 (socket says 172.21.15.12:36686) 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f6716ffd640 1 -- 172.21.15.12:0/2231630091 learned_addr learned my addr 172.21.15.12:0/2231630091 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f67177fe640 1 --2- 172.21.15.12:0/2231630091 >> v2:172.21.15.100:3300/0 conn(0x7f671815e940 0x7f67180d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f6717fff640 1 -- 172.21.15.12:0/2231630091 >> v2:172.21.15.100:3300/0 conn(0x7f671815e940 msgr2=0x7f67180d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f6717fff640 1 --2- 172.21.15.12:0/2231630091 >> v2:172.21.15.100:3300/0 conn(0x7f671815e940 0x7f67180d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f6717fff640 1 -- 172.21.15.12:0/2231630091 >> v1:172.21.15.12:6789/0 conn(0x7f671815ed20 legacy=0x7f67180b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f6717fff640 1 -- 172.21.15.12:0/2231630091 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67180d3660 con 0x7f67180cef90 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.565+0000 7f67167fc640 1 -- 172.21.15.12:0/2231630091 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073941968 0 0) 0x7f670c001110 con 0x7f671815ed20 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f6717fff640 1 --2- 172.21.15.12:0/2231630091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180d15a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f67180509d0 tx=0x7f671002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6e6e0b463d2598 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f67167fc640 1 -- 172.21.15.12:0/2231630091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710007740 con 0x7f67180cef90 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f67167fc640 1 -- 172.21.15.12:0/2231630091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67100078e0 con 0x7f67180cef90 2024-09-10T09:23:09.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f67167fc640 1 -- 172.21.15.12:0/2231630091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710007cb0 con 0x7f67180cef90 2024-09-10T09:23:09.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 -- 172.21.15.12:0/2231630091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 msgr2=0x7f67180d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 --2- 172.21.15.12:0/2231630091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180d15a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f67180509d0 tx=0x7f671002a710 comp rx=0 tx=0).stop 2024-09-10T09:23:09.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 -- 172.21.15.12:0/2231630091 shutdown_connections 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 --2- 172.21.15.12:0/2231630091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180d15a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 --2- 172.21.15.12:0/2231630091 >> v2:172.21.15.100:3300/0 conn(0x7f671815e940 0x7f67180d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 -- 172.21.15.12:0/2231630091 >> 172.21.15.12:0/2231630091 conn(0x7f67180b6240 msgr2=0x7f67180b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 -- 172.21.15.12:0/2231630091 shutdown_connections 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.566+0000 7f671dac9640 1 -- 172.21.15.12:0/2231630091 wait complete. 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.567+0000 7f671dac9640 1 Processor -- start 2024-09-10T09:23:09.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 -- start start 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f671815e940 0x7f6718156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f671815ed20 0x7f671815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67180d3f00 con 0x7f67180cef90 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67180d3c20 con 0x7f671815e940 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f671dac9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f67180d3310 con 0x7f671815ed20 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.568+0000 7f67177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43714/0 (socket says 172.21.15.12:43714) 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 -- 172.21.15.12:0/3523911299 learned_addr learned my addr 172.21.15.12:0/3523911299 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f6716ffd640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f671815e940 0x7f6718156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f6717fff640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f671815ed20 0x7f671815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 -- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f671815ed20 msgr2=0x7f671815fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f671815ed20 0x7f671815fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 -- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f671815e940 msgr2=0x7f6718156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f671815e940 0x7f6718156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 -- 172.21.15.12:0/3523911299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6718156ba0 con 0x7f67180cef90 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f67177fe640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180ce620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f670800d800 tx=0x7f670800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670800b6c0 con 0x7f67180cef90 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6708019070 con 0x7f67180cef90 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67180b51d0 con 0x7f67180cef90 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670800ba80 con 0x7f67180cef90 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.569+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6718158b70 con 0x7f67180cef90 2024-09-10T09:23:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.570+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67180ba160 con 0x7f67180cef90 2024-09-10T09:23:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.571+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f670800bc20 con 0x7f67180cef90 2024-09-10T09:23:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.571+0000 7f66fffff640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.571+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f670808add0 con 0x7f67180cef90 2024-09-10T09:23:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.571+0000 7f6716ffd640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.572+0000 7f6716ffd640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f670406be30 0x7f670406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f670c000f60 tx=0x7f670c007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.575+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67180ba160 con 0x7f67180cef90 2024-09-10T09:23:09.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.819+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f67180ceb60 con 0x7f67180cef90 2024-09-10T09:23:09.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.821+0000 7f66fffff640 1 -- 172.21.15.12:0/3523911299 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f670808c0a0 con 0x7f67180cef90 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f670406be30 msgr2=0x7f670406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f670406be30 0x7f670406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f670c000f60 tx=0x7f670c007b50 comp rx=0 tx=0).stop 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 msgr2=0x7f67180ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180ce620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f670800d800 tx=0x7f670800dcc0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 shutdown_connections 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f671815ed20 0x7f671815fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f671815e940 0x7f6718156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 --2- 172.21.15.12:0/3523911299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67180cef90 0x7f67180ce620 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 >> 172.21.15.12:0/3523911299 conn(0x7f67180b6240 msgr2=0x7f6718160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 shutdown_connections 2024-09-10T09:23:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.824+0000 7f671dac9640 1 -- 172.21.15.12:0/3523911299 wait complete. 2024-09-10T09:23:09.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T09:23:09.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.939+0000 7fbf87647640 1 Processor -- start 2024-09-10T09:23:09.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.939+0000 7fbf87647640 1 -- start start 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf87647640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbf8015ed20 0x7fbf800b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf87647640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 0x7fbf800b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf87647640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf800b7170 con 0x7fbf8015e940 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf87647640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbf800b7aa0 con 0x7fbf8015ed20 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf87647640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbf800d3660 con 0x7fbf800cef90 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf853e3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf8015e940 0x7fbf800d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36690/0 (socket says 172.21.15.12:36690) 2024-09-10T09:23:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.940+0000 7fbf853e3640 1 -- 172.21.15.12:0/3312686360 learned_addr learned my addr 172.21.15.12:0/3312686360 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf84be2640 1 --2- 172.21.15.12:0/3312686360 >> v2:172.21.15.100:3300/0 conn(0x7fbf8015ed20 0x7fbf800b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf85be4640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 0x7fbf800b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101509369 0 0) 0x7fbf7c001110 con 0x7fbf8015e940 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf6c003520 con 0x7fbf8015e940 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1937759240 0 0) 0x7fbf6c003520 con 0x7fbf8015e940 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 msgr2=0x7fbf800b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 0x7fbf800b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 >> v2:172.21.15.100:3300/0 conn(0x7fbf8015ed20 msgr2=0x7fbf800b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 --2- 172.21.15.12:0/3312686360 >> v2:172.21.15.100:3300/0 conn(0x7fbf8015ed20 0x7fbf800b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf800d3940 con 0x7fbf8015e940 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fbf7c001840 con 0x7fbf8015e940 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 >> v1:172.21.15.12:6789/0 conn(0x7fbf8015e940 legacy=0x7fbf800d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c0039b0 0x7fbf6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf6c004800 0x7fbf6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 0x7fbf6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800b7aa0 con 0x7fbf6c004800 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800d3660 con 0x7fbf6c0039b0 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6c00b9c0 con 0x7fbf800cef90 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf84be2640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf6c004800 0x7fbf6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf853e3640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c0039b0 0x7fbf6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.941+0000 7fbf85be4640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 0x7fbf6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf84be2640 1 -- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 msgr2=0x7fbf6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf84be2640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf800cef90 0x7fbf6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf84be2640 1 -- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c0039b0 msgr2=0x7fbf6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf84be2640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c0039b0 0x7fbf6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf84be2640 1 -- 172.21.15.12:0/3312686360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c003520 con 0x7fbf6c004800 2024-09-10T09:23:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf84be2640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf6c004800 0x7fbf6c004c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009a90 tx=0x7fbf6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771b3009d772c34f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70036070 con 0x7fbf6c004800 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf70031400 con 0x7fbf6c004800 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.942+0000 7fbf77fff640 1 -- 172.21.15.12:0/3312686360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70009690 con 0x7fbf6c004800 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf87647640 1 -- 172.21.15.12:0/3312686360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf6c004800 msgr2=0x7fbf6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf87647640 1 --2- 172.21.15.12:0/3312686360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf6c004800 0x7fbf6c004c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009a90 tx=0x7fbf6c005830 comp rx=0 tx=0).stop 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf85be4640 1 -- 172.21.15.12:0/3312686360 reap_dead start 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf87647640 1 -- 172.21.15.12:0/3312686360 shutdown_connections 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf87647640 1 -- 172.21.15.12:0/3312686360 >> 172.21.15.12:0/3312686360 conn(0x7fbf800b6240 msgr2=0x7fbf800b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf87647640 1 -- 172.21.15.12:0/3312686360 shutdown_connections 2024-09-10T09:23:09.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.943+0000 7fbf87647640 1 -- 172.21.15.12:0/3312686360 wait complete. 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.944+0000 7fbf87647640 1 Processor -- start 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.944+0000 7fbf87647640 1 -- start start 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf87647640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c004800 0x7fbf800ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf87647640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 0x7fbf801e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf87647640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf80158530 0x7fbf801e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf87647640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800d3310 con 0x7fbf801580b0 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf87647640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800d3f00 con 0x7fbf6c004800 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf87647640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbf800d1ef0 con 0x7fbf80158530 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf84be2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 0x7fbf801e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf84be2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 0x7fbf801e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43726/0 (socket says 172.21.15.12:43726) 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf84be2640 1 -- 172.21.15.12:0/2864848973 learned_addr learned my addr 172.21.15.12:0/2864848973 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:09.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf85be4640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf80158530 0x7fbf801e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.945+0000 7fbf853e3640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c004800 0x7fbf800ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf84be2640 1 -- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf80158530 msgr2=0x7fbf801e97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf84be2640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf80158530 0x7fbf801e97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf84be2640 1 -- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c004800 msgr2=0x7fbf800ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf84be2640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c004800 0x7fbf800ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf84be2640 1 -- 172.21.15.12:0/2864848973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf800caa80 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf84be2640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 0x7fbf801e92a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf70034040 tx=0x7fbf70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70040020 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf70003890 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70036040 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf800c85b0 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.946+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf800c8b70 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.947+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf800d1060 con 0x7fbf801580b0 2024-09-10T09:23:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.948+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf70043020 con 0x7fbf801580b0 2024-09-10T09:23:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.948+0000 7fbf75ffb640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf6406be30 0x7fbf6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.948+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fbf700aae10 con 0x7fbf801580b0 2024-09-10T09:23:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.948+0000 7fbf853e3640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf6406be30 0x7fbf6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.949+0000 7fbf853e3640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf6406be30 0x7fbf6406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0017a0 tx=0x7fbf7c007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:09.953+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf7004a030 con 0x7fbf801580b0 2024-09-10T09:23:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.197+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fbf800ba6b0 con 0x7fbf801580b0 2024-09-10T09:23:10.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.199+0000 7fbf75ffb640 1 -- 172.21.15.12:0/2864848973 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fbf70079550 con 0x7fbf801580b0 2024-09-10T09:23:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf6406be30 msgr2=0x7fbf6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf6406be30 0x7fbf6406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0017a0 tx=0x7fbf7c007aa0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 msgr2=0x7fbf801e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 0x7fbf801e92a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf70034040 tx=0x7fbf70004730 comp rx=0 tx=0).stop 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 shutdown_connections 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbf6406be30 0x7fbf6406e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf80158530 0x7fbf801e97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf801580b0 0x7fbf801e92a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 --2- 172.21.15.12:0/2864848973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf6c004800 0x7fbf800ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 >> 172.21.15.12:0/2864848973 conn(0x7fbf800b6240 msgr2=0x7fbf80161770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 shutdown_connections 2024-09-10T09:23:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.201+0000 7fbf87647640 1 -- 172.21.15.12:0/2864848973 wait complete. 2024-09-10T09:23:10.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T09:23:10.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.315+0000 7f89e06af640 1 Processor -- start 2024-09-10T09:23:10.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.315+0000 7f89e06af640 1 -- start start 2024-09-10T09:23:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89e06af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d8140a40 0x7f89d815c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89e06af640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89d80727d0 0x7f89d80b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89e06af640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d80b4ee0 con 0x7f89d813eaf0 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89e06af640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f89d80b5780 con 0x7f89d80727d0 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89e06af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f89d813ef30 con 0x7f89d8140a40 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89dec4c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89d80727d0 0x7f89d80b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89ddc4a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f89d813eaf0 0x7f89d80720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36692/0 (socket says 172.21.15.12:36692) 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.316+0000 7f89ddc4a640 1 -- 172.21.15.12:0/2368321322 learned_addr learned my addr 172.21.15.12:0/2368321322 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89de44b640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d8140a40 0x7f89d815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89dec4c640 1 -- 172.21.15.12:0/2368321322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d8140a40 msgr2=0x7f89d815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89dec4c640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d8140a40 0x7f89d815c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89dec4c640 1 -- 172.21.15.12:0/2368321322 >> v1:172.21.15.12:6789/0 conn(0x7f89d813eaf0 legacy=0x7f89d80720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89dd449640 1 -- 172.21.15.12:0/2368321322 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932601570 0 0) 0x7f89d80b4ee0 con 0x7f89d813eaf0 2024-09-10T09:23:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89dec4c640 1 -- 172.21.15.12:0/2368321322 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d80b51c0 con 0x7f89d80727d0 2024-09-10T09:23:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.317+0000 7f89de44b640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d8140a40 0x7f89d815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89dec4c640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d80727d0 0x7f89d80b47e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f89d80b5900 tx=0x7f89c802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5d5f25a4b00de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89dd449640 1 -- 172.21.15.12:0/2368321322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8007740 con 0x7f89d80727d0 2024-09-10T09:23:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89dd449640 1 -- 172.21.15.12:0/2368321322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c80078e0 con 0x7f89d80727d0 2024-09-10T09:23:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89dd449640 1 -- 172.21.15.12:0/2368321322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8007cb0 con 0x7f89d80727d0 2024-09-10T09:23:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 -- 172.21.15.12:0/2368321322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d80727d0 msgr2=0x7f89d80b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d80727d0 0x7f89d80b47e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f89d80b5900 tx=0x7f89c802a5b0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 -- 172.21.15.12:0/2368321322 shutdown_connections 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d80727d0 0x7f89d80b47e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 --2- 172.21.15.12:0/2368321322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d8140a40 0x7f89d815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 -- 172.21.15.12:0/2368321322 >> 172.21.15.12:0/2368321322 conn(0x7f89d8062a80 msgr2=0x7f89d806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 -- 172.21.15.12:0/2368321322 shutdown_connections 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.318+0000 7f89e06af640 1 -- 172.21.15.12:0/2368321322 wait complete. 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.319+0000 7f89e06af640 1 Processor -- start 2024-09-10T09:23:10.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 -- start start 2024-09-10T09:23:10.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d80727d0 0x7f89d81e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 0x7f89d806c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89d8140a40 0x7f89d806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89d8140e20 con 0x7f89d813eaf0 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80b5ad0 con 0x7f89d8140a40 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89e06af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f89d80b5ff0 con 0x7f89d80727d0 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89ddc4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 0x7f89d806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89ddc4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 0x7f89d806c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43734/0 (socket says 172.21.15.12:43734) 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.320+0000 7f89ddc4a640 1 -- 172.21.15.12:0/2276260491 learned_addr learned my addr 172.21.15.12:0/2276260491 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89de44b640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d80727d0 0x7f89d81e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89dec4c640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89d8140a40 0x7f89d806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89ddc4a640 1 -- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d80727d0 msgr2=0x7f89d81e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89ddc4a640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d80727d0 0x7f89d81e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89ddc4a640 1 -- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89d8140a40 msgr2=0x7f89d806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89ddc4a640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89d8140a40 0x7f89d806c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89ddc4a640 1 -- 172.21.15.12:0/2276260491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d81e1b80 con 0x7f89d813eaf0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89dec4c640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89d8140a40 0x7f89d806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89ddc4a640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 0x7f89d806c080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c4b0 tx=0x7f89cc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc018070 con 0x7f89d813eaf0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc007500 con 0x7f89d813eaf0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d81e1e60 con 0x7f89d813eaf0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc004a20 con 0x7f89d813eaf0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.321+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d8143d00 con 0x7f89d813eaf0 2024-09-10T09:23:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.322+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d815c480 con 0x7f89d813eaf0 2024-09-10T09:23:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.323+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89cc01b070 con 0x7f89d813eaf0 2024-09-10T09:23:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.323+0000 7f89d6ffd640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.324+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f89cc089e10 con 0x7f89d813eaf0 2024-09-10T09:23:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.324+0000 7f89de44b640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.324+0000 7f89de44b640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f89c406be30 0x7f89c406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89d81e19a0 tx=0x7f89d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:10.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.328+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89cc08d030 con 0x7f89d813eaf0 2024-09-10T09:23:10.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.576+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f89d80d0ae0 con 0x7f89d813eaf0 2024-09-10T09:23:10.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.578+0000 7f89d6ffd640 1 -- 172.21.15.12:0/2276260491 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f89cc058570 con 0x7f89d813eaf0 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f89c406be30 msgr2=0x7f89c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f89c406be30 0x7f89c406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89d81e19a0 tx=0x7f89d0008040 comp rx=0 tx=0).stop 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 msgr2=0x7f89d806c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 0x7f89d806c080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c4b0 tx=0x7f89cc00c970 comp rx=0 tx=0).stop 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 shutdown_connections 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f89c406be30 0x7f89c406e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89d8140a40 0x7f89d806c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89d813eaf0 0x7f89d806c080 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 --2- 172.21.15.12:0/2276260491 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89d80727d0 0x7f89d81e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 >> 172.21.15.12:0/2276260491 conn(0x7f89d8062a80 msgr2=0x7f89d806f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:10.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 shutdown_connections 2024-09-10T09:23:10.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.580+0000 7f89e06af640 1 -- 172.21.15.12:0/2276260491 wait complete. 2024-09-10T09:23:10.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T09:23:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.695+0000 7fb3ff586640 1 Processor -- start 2024-09-10T09:23:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.695+0000 7fb3ff586640 1 -- start start 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3ff586640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 0x7fb3f80d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3ff586640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3f80cef90 0x7fb3f80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3ff586640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f80b7170 con 0x7fb3f815ed20 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3ff586640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f80d1ae0 con 0x7fb3f80cef90 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3ff586640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f80b7aa0 con 0x7fb3f815e940 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fd322640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 0x7fb3f80d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fdb23640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3f80cef90 0x7fb3f80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fcb21640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb3f815ed20 0x7fb3f80b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:59224/0 (socket says 172.21.15.12:59224) 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fcb21640 1 -- 172.21.15.12:0/1988297869 learned_addr learned my addr 172.21.15.12:0/1988297869 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fd322640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 0x7fb3f80d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:43492/0 (socket says 172.21.15.12:43492) 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fd322640 1 -- 172.21.15.12:0/1988297869 >> v2:172.21.15.100:3300/0 conn(0x7fb3f80cef90 msgr2=0x7fb3f80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fd322640 1 --2- 172.21.15.12:0/1988297869 >> v2:172.21.15.100:3300/0 conn(0x7fb3f80cef90 0x7fb3f80d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fd322640 1 -- 172.21.15.12:0/1988297869 >> v1:172.21.15.100:6789/0 conn(0x7fb3f815ed20 legacy=0x7fb3f80b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fd322640 1 -- 172.21.15.12:0/1988297869 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f80d3660 con 0x7fb3f815e940 2024-09-10T09:23:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.696+0000 7fb3fdb23640 1 --2- 172.21.15.12:0/1988297869 >> v2:172.21.15.100:3300/0 conn(0x7fb3f80cef90 0x7fb3f80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.697+0000 7fb3fd322640 1 --2- 172.21.15.12:0/1988297869 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 0x7fb3f80d1060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40097a0 tx=0x7fb3f402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62fe0b509da23c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.697+0000 7fb3effff640 1 -- 172.21.15.12:0/1988297869 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4037070 con 0x7fb3f815e940 2024-09-10T09:23:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.697+0000 7fb3effff640 1 -- 172.21.15.12:0/1988297869 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4032440 con 0x7fb3f815e940 2024-09-10T09:23:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.697+0000 7fb3effff640 1 -- 172.21.15.12:0/1988297869 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4032810 con 0x7fb3f815e940 2024-09-10T09:23:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 -- 172.21.15.12:0/1988297869 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 msgr2=0x7fb3f80d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 --2- 172.21.15.12:0/1988297869 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 0x7fb3f80d1060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40097a0 tx=0x7fb3f402a210 comp rx=0 tx=0).stop 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 -- 172.21.15.12:0/1988297869 shutdown_connections 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 --2- 172.21.15.12:0/1988297869 >> v2:172.21.15.100:3300/0 conn(0x7fb3f80cef90 0x7fb3f80d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 --2- 172.21.15.12:0/1988297869 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815e940 0x7fb3f80d1060 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 -- 172.21.15.12:0/1988297869 >> 172.21.15.12:0/1988297869 conn(0x7fb3f80b6240 msgr2=0x7fb3f80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 -- 172.21.15.12:0/1988297869 shutdown_connections 2024-09-10T09:23:10.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.698+0000 7fb3ff586640 1 -- 172.21.15.12:0/1988297869 wait complete. 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.699+0000 7fb3ff586640 1 Processor -- start 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.699+0000 7fb3ff586640 1 -- start start 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3ff586640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 0x7fb3f8156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3ff586640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f815e940 0x7fb3f80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3ff586640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815ed20 0x7fb3f81e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3ff586640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f80d3f00 con 0x7fb3f80cef90 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3ff586640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f80d3c20 con 0x7fb3f815e940 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3ff586640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f80d3310 con 0x7fb3f815ed20 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3fd322640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 0x7fb3f8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3fd322640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 0x7fb3f8156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43750/0 (socket says 172.21.15.12:43750) 2024-09-10T09:23:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3fd322640 1 -- 172.21.15.12:0/475305618 learned_addr learned my addr 172.21.15.12:0/475305618 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3fdb23640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815ed20 0x7fb3f81e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.700+0000 7fb3fcb21640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f815e940 0x7fb3f80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3fd322640 1 -- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815ed20 msgr2=0x7fb3f81e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3fd322640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815ed20 0x7fb3f81e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3fd322640 1 -- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f815e940 msgr2=0x7fb3f80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3fd322640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f815e940 0x7fb3f80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3fd322640 1 -- 172.21.15.12:0/475305618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f81e8c20 con 0x7fb3f80cef90 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3fd322640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 0x7fb3f8156040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4035040 tx=0x7fb3f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4037040 con 0x7fb3f80cef90 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4030440 con 0x7fb3f80cef90 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f81e8f00 con 0x7fb3f80cef90 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4030850 con 0x7fb3f80cef90 2024-09-10T09:23:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.701+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f81e94c0 con 0x7fb3f80cef90 2024-09-10T09:23:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.702+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f8068cd0 con 0x7fb3f80cef90 2024-09-10T09:23:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.703+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3f4044020 con 0x7fb3f80cef90 2024-09-10T09:23:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.703+0000 7fb3edffb640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb3dc06be30 0x7fb3dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.703+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb3f40aad60 con 0x7fb3f80cef90 2024-09-10T09:23:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.703+0000 7fb3fcb21640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb3dc06be30 0x7fb3dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.704+0000 7fb3fcb21640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb3dc06be30 0x7fb3dc06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3f81ea240 tx=0x7fb3e8007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.707+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3f8068cd0 con 0x7fb3f80cef90 2024-09-10T09:23:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.958+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fb3f80ba6b0 con 0x7fb3f80cef90 2024-09-10T09:23:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.960+0000 7fb3edffb640 1 -- 172.21.15.12:0/475305618 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fb3f4079950 con 0x7fb3f80cef90 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb3dc06be30 msgr2=0x7fb3dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb3dc06be30 0x7fb3dc06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3f81ea240 tx=0x7fb3e8007e80 comp rx=0 tx=0).stop 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 msgr2=0x7fb3f8156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 0x7fb3f8156040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4035040 tx=0x7fb3f40046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 shutdown_connections 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb3dc06be30 0x7fb3dc06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f815ed20 0x7fb3f81e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f815e940 0x7fb3f80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 --2- 172.21.15.12:0/475305618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3f80cef90 0x7fb3f8156040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 >> 172.21.15.12:0/475305618 conn(0x7fb3f80b6240 msgr2=0x7fb3f80cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 shutdown_connections 2024-09-10T09:23:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:10.962+0000 7fb3ff586640 1 -- 172.21.15.12:0/475305618 wait complete. 2024-09-10T09:23:10.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T09:23:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.077+0000 7fc978ad0640 1 Processor -- start 2024-09-10T09:23:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.077+0000 7fc978ad0640 1 -- start start 2024-09-10T09:23:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc978ad0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc97415ed20 0x7fc9740b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc978ad0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9740b7170 con 0x7fc97415e940 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc978ad0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9740b7aa0 con 0x7fc9740cef90 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc978ad0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc9740d3660 con 0x7fc97415ed20 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc969d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc97415ed20 0x7fc9740b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc97259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc97415e940 0x7fc9740d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36694/0 (socket says 172.21.15.12:36694) 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc97259c640 1 -- 172.21.15.12:0/3167799787 learned_addr learned my addr 172.21.15.12:0/3167799787 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc969d9b640 1 -- 172.21.15.12:0/3167799787 >> v1:172.21.15.100:6789/0 conn(0x7fc9740cef90 legacy=0x7fc9740b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc969d9b640 1 -- 172.21.15.12:0/3167799787 >> v1:172.21.15.12:6789/0 conn(0x7fc97415e940 legacy=0x7fc9740d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc969d9b640 1 -- 172.21.15.12:0/3167799787 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9740d3940 con 0x7fc97415ed20 2024-09-10T09:23:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.078+0000 7fc971d9b640 1 -- 172.21.15.12:0/3167799787 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096903697 0 0) 0x7fc964001110 con 0x7fc97415e940 2024-09-10T09:23:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.079+0000 7fc969d9b640 1 --2- 172.21.15.12:0/3167799787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415ed20 0x7fc9740b3220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0097a0 tx=0x7fc95c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ece54f11d1fa7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.079+0000 7fc971d9b640 1 -- 172.21.15.12:0/3167799787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c037070 con 0x7fc97415ed20 2024-09-10T09:23:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.079+0000 7fc971d9b640 1 -- 172.21.15.12:0/3167799787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c032440 con 0x7fc97415ed20 2024-09-10T09:23:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.079+0000 7fc971d9b640 1 -- 172.21.15.12:0/3167799787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c032810 con 0x7fc97415ed20 2024-09-10T09:23:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 -- 172.21.15.12:0/3167799787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415ed20 msgr2=0x7fc9740b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 --2- 172.21.15.12:0/3167799787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415ed20 0x7fc9740b3220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0097a0 tx=0x7fc95c02a270 comp rx=0 tx=0).stop 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 -- 172.21.15.12:0/3167799787 shutdown_connections 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 --2- 172.21.15.12:0/3167799787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415ed20 0x7fc9740b3220 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 -- 172.21.15.12:0/3167799787 >> 172.21.15.12:0/3167799787 conn(0x7fc9740b6240 msgr2=0x7fc9740b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 -- 172.21.15.12:0/3167799787 shutdown_connections 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.080+0000 7fc978ad0640 1 -- 172.21.15.12:0/3167799787 wait complete. 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.081+0000 7fc978ad0640 1 Processor -- start 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.081+0000 7fc978ad0640 1 -- start start 2024-09-10T09:23:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc978ad0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9740cef90 0x7fc9740b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc978ad0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 0x7fc9740cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc978ad0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97415ed20 0x7fc97415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc978ad0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9740d3310 con 0x7fc97415e940 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc978ad0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc9740d3f00 con 0x7fc97415ed20 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc978ad0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc9740d1ef0 con 0x7fc9740cef90 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 0x7fc9740cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 0x7fc9740cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43768/0 (socket says 172.21.15.12:43768) 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 -- 172.21.15.12:0/2945086564 learned_addr learned my addr 172.21.15.12:0/2945086564 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc97259c640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9740cef90 0x7fc9740b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc972d9d640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97415ed20 0x7fc97415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 -- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9740cef90 msgr2=0x7fc9740b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9740cef90 0x7fc9740b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 -- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97415ed20 msgr2=0x7fc97415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97415ed20 0x7fc97415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc969d9b640 1 -- 172.21.15.12:0/2945086564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97414c6c0 con 0x7fc97415e940 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.082+0000 7fc972d9d640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97415ed20 0x7fc97415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.083+0000 7fc969d9b640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 0x7fc9740cada0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0098c0 tx=0x7fc95c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.083+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c041070 con 0x7fc97415e940 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.083+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c03c870 con 0x7fc97415e940 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.083+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9740c8470 con 0x7fc97415e940 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.083+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c037040 con 0x7fc97415e940 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.083+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9740c8a30 con 0x7fc97415e940 2024-09-10T09:23:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.084+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9740d1060 con 0x7fc97415e940 2024-09-10T09:23:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.084+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc95c044070 con 0x7fc97415e940 2024-09-10T09:23:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.085+0000 7fc96b7fe640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc95406be30 0x7fc95406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.085+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fc95c0ab730 con 0x7fc97415e940 2024-09-10T09:23:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.085+0000 7fc97259c640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc95406be30 0x7fc95406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.085+0000 7fc97259c640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc95406be30 0x7fc95406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc964000f60 tx=0x7fc964007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.089+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc95c079e80 con 0x7fc97415e940 2024-09-10T09:23:11.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.335+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fc9740d1ac0 con 0x7fc97415e940 2024-09-10T09:23:11.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.338+0000 7fc96b7fe640 1 -- 172.21.15.12:0/2945086564 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fc95c07e180 con 0x7fc97415e940 2024-09-10T09:23:11.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc95406be30 msgr2=0x7fc95406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc95406be30 0x7fc95406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc964000f60 tx=0x7fc964007b50 comp rx=0 tx=0).stop 2024-09-10T09:23:11.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 msgr2=0x7fc9740cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 0x7fc9740cada0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0098c0 tx=0x7fc95c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 shutdown_connections 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc95406be30 0x7fc95406e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97415ed20 0x7fc97415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97415e940 0x7fc9740cada0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 --2- 172.21.15.12:0/2945086564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9740cef90 0x7fc9740b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 >> 172.21.15.12:0/2945086564 conn(0x7fc9740b6240 msgr2=0x7fc97415fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 shutdown_connections 2024-09-10T09:23:11.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.340+0000 7fc978ad0640 1 -- 172.21.15.12:0/2945086564 wait complete. 2024-09-10T09:23:11.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T09:23:11.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.455+0000 7f244f7d6640 1 Processor -- start 2024-09-10T09:23:11.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.455+0000 7f244f7d6640 1 -- start start 2024-09-10T09:23:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244f7d6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f244815e860 0x7f24480cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244f7d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f24480b8ab0 0x7f24480b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244f7d6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24480d34d0 con 0x7f24480b61f0 2024-09-10T09:23:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244f7d6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f24480b6b80 con 0x7f244815e860 2024-09-10T09:23:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244f7d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f24480d3790 con 0x7f24480b8ab0 2024-09-10T09:23:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244d572640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f244815e860 0x7f24480cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244cd71640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f24480b61f0 0x7f244806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36696/0 (socket says 172.21.15.12:36696) 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244cd71640 1 -- 172.21.15.12:0/4267634159 learned_addr learned my addr 172.21.15.12:0/4267634159 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244d572640 1 --2- 172.21.15.12:0/4267634159 >> v2:172.21.15.12:3300/0 conn(0x7f244815e860 0x7f24480cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43784/0 (socket says 172.21.15.12:43784) 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244dd73640 1 --2- 172.21.15.12:0/4267634159 >> v2:172.21.15.100:3300/0 conn(0x7f24480b8ab0 0x7f24480b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244d572640 1 -- 172.21.15.12:0/4267634159 >> v2:172.21.15.100:3300/0 conn(0x7f24480b8ab0 msgr2=0x7f24480b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244d572640 1 --2- 172.21.15.12:0/4267634159 >> v2:172.21.15.100:3300/0 conn(0x7f24480b8ab0 0x7f24480b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244d572640 1 -- 172.21.15.12:0/4267634159 >> v1:172.21.15.12:6789/0 conn(0x7f24480b61f0 legacy=0x7f244806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244d572640 1 -- 172.21.15.12:0/4267634159 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480d3a70 con 0x7f244815e860 2024-09-10T09:23:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.456+0000 7f244dd73640 1 --2- 172.21.15.12:0/4267634159 >> v2:172.21.15.100:3300/0 conn(0x7f24480b8ab0 0x7f24480b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.457+0000 7f244d572640 1 --2- 172.21.15.12:0/4267634159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480cf720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f24480b38d0 tx=0x7f244402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341678420e0941ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.457+0000 7f243ffff640 1 -- 172.21.15.12:0/4267634159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444037070 con 0x7f244815e860 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.457+0000 7f243ffff640 1 -- 172.21.15.12:0/4267634159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2444032440 con 0x7f244815e860 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.457+0000 7f243ffff640 1 -- 172.21.15.12:0/4267634159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444032810 con 0x7f244815e860 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 -- 172.21.15.12:0/4267634159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 msgr2=0x7f24480cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 --2- 172.21.15.12:0/4267634159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480cf720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f24480b38d0 tx=0x7f244402a230 comp rx=0 tx=0).stop 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 -- 172.21.15.12:0/4267634159 shutdown_connections 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 --2- 172.21.15.12:0/4267634159 >> v2:172.21.15.100:3300/0 conn(0x7f24480b8ab0 0x7f24480b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 --2- 172.21.15.12:0/4267634159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480cf720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 -- 172.21.15.12:0/4267634159 >> 172.21.15.12:0/4267634159 conn(0x7f2448062c60 msgr2=0x7f24480d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 -- 172.21.15.12:0/4267634159 shutdown_connections 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.458+0000 7f244f7d6640 1 -- 172.21.15.12:0/4267634159 wait complete. 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.459+0000 7f244f7d6640 1 Processor -- start 2024-09-10T09:23:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.459+0000 7f244f7d6640 1 -- start start 2024-09-10T09:23:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244f7d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24480b61f0 0x7f24481f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244f7d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24480b8ab0 0x7f24481502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244f7d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244f7d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f24480d4310 con 0x7f244815e860 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244f7d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24480d4030 con 0x7f24480b8ab0 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244f7d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f244815ec40 con 0x7f24480b61f0 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43796/0 (socket says 172.21.15.12:43796) 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 -- 172.21.15.12:0/1453593210 learned_addr learned my addr 172.21.15.12:0/1453593210 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244d572640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24480b61f0 0x7f24481f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244cd71640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24480b8ab0 0x7f24481502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 -- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24480b61f0 msgr2=0x7f24481f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24480b61f0 0x7f24481f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 -- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24480b8ab0 msgr2=0x7f24481502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24480b8ab0 0x7f24481502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 -- 172.21.15.12:0/1453593210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24481507e0 con 0x7f244815e860 2024-09-10T09:23:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.460+0000 7f244dd73640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480d1400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f244000cef0 tx=0x7f244000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.461+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244001a070 con 0x7f244815e860 2024-09-10T09:23:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.461+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244000d860 con 0x7f244815e860 2024-09-10T09:23:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.461+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244000dc50 con 0x7f244815e860 2024-09-10T09:23:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.461+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244814d800 con 0x7f244815e860 2024-09-10T09:23:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.461+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24481f4e20 con 0x7f244815e860 2024-09-10T09:23:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.462+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24481f48c0 con 0x7f244815e860 2024-09-10T09:23:11.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.462+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f244001d070 con 0x7f244815e860 2024-09-10T09:23:11.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.463+0000 7f243dffb640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f242c06be30 0x7f242c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.463+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f244008b3f0 con 0x7f244815e860 2024-09-10T09:23:11.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.463+0000 7f244d572640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f242c06be30 0x7f242c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.464+0000 7f244d572640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f242c06be30 0x7f242c06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2444034000 tx=0x7f244402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.467+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24481f48c0 con 0x7f244815e860 2024-09-10T09:23:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.713+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f24480d2700 con 0x7f244815e860 2024-09-10T09:23:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.715+0000 7f243dffb640 1 -- 172.21.15.12:0/1453593210 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f24481507e0 con 0x7f244815e860 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f242c06be30 msgr2=0x7f242c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f242c06be30 0x7f242c06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2444034000 tx=0x7f244402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 msgr2=0x7f24480d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480d1400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f244000cef0 tx=0x7f244000a710 comp rx=0 tx=0).stop 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 shutdown_connections 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f242c06be30 0x7f242c06e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f244815e860 0x7f24480d1400 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24480b8ab0 0x7f24481502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 --2- 172.21.15.12:0/1453593210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24480b61f0 0x7f24481f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 >> 172.21.15.12:0/1453593210 conn(0x7f2448062c60 msgr2=0x7f24480b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 shutdown_connections 2024-09-10T09:23:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.717+0000 7f244f7d6640 1 -- 172.21.15.12:0/1453593210 wait complete. 2024-09-10T09:23:11.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T09:23:11.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.830+0000 7fa9c6465640 1 Processor -- start 2024-09-10T09:23:11.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.831+0000 7fa9c6465640 1 -- start start 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.831+0000 7fa9c6465640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c015c690 0x7fa9c00b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.831+0000 7fa9c6465640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c0073da0 con 0x7fa9c00b1980 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.831+0000 7fa9c6465640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c0074060 con 0x7fa9c00b4290 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.831+0000 7fa9c6465640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c00b6aa0 con 0x7fa9c015c690 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9bf7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa9c00b1980 0x7fa9c00d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36712/0 (socket says 172.21.15.12:36712) 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9bf7fe640 1 -- 172.21.15.12:0/3147018671 learned_addr learned my addr 172.21.15.12:0/3147018671 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9bffff640 1 --2- 172.21.15.12:0/3147018671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c015c690 0x7fa9c00b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017958885 0 0) 0x7fa9c0073da0 con 0x7fa9c00b1980 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a8003520 con 0x7fa9c00b1980 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285680453 0 0) 0x7fa9c0074060 con 0x7fa9c00b4290 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9c0073da0 con 0x7fa9c00b4290 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9bffff640 1 -- 172.21.15.12:0/3147018671 >> v1:172.21.15.100:6789/0 conn(0x7fa9c00b4290 legacy=0x7fa9c00b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9bffff640 1 -- 172.21.15.12:0/3147018671 >> v1:172.21.15.12:6789/0 conn(0x7fa9c00b1980 legacy=0x7fa9c00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.832+0000 7fa9bffff640 1 -- 172.21.15.12:0/3147018671 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c00733a0 con 0x7fa9c015c690 2024-09-10T09:23:11.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.833+0000 7fa9bffff640 1 --2- 172.21.15.12:0/3147018671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c015c690 0x7fa9c00b6010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00097d0 tx=0x7fa9b002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b4eb6246bf71ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.833+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0037070 con 0x7fa9c015c690 2024-09-10T09:23:11.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.833+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b0032440 con 0x7fa9c015c690 2024-09-10T09:23:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.833+0000 7fa9beffd640 1 -- 172.21.15.12:0/3147018671 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00327f0 con 0x7fa9c015c690 2024-09-10T09:23:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 -- 172.21.15.12:0/3147018671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c015c690 msgr2=0x7fa9c00b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3147018671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c015c690 0x7fa9c00b6010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00097d0 tx=0x7fa9b002a210 comp rx=0 tx=0).stop 2024-09-10T09:23:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 -- 172.21.15.12:0/3147018671 shutdown_connections 2024-09-10T09:23:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3147018671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c015c690 0x7fa9c00b6010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 -- 172.21.15.12:0/3147018671 >> 172.21.15.12:0/3147018671 conn(0x7fa9c0062630 msgr2=0x7fa9c0062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:11.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 -- 172.21.15.12:0/3147018671 shutdown_connections 2024-09-10T09:23:11.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.834+0000 7fa9c6465640 1 -- 172.21.15.12:0/3147018671 wait complete. 2024-09-10T09:23:11.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.835+0000 7fa9c6465640 1 Processor -- start 2024-09-10T09:23:11.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.835+0000 7fa9c6465640 1 -- start start 2024-09-10T09:23:11.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c6465640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c00b1980 0x7fa9c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c6465640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 0x7fa9c014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c6465640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9c015c690 0x7fa9c015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c6465640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00d0dd0 con 0x7fa9c00b4290 2024-09-10T09:23:11.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c6465640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00d0c50 con 0x7fa9c015c690 2024-09-10T09:23:11.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c6465640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c00b76d0 con 0x7fa9c00b1980 2024-09-10T09:23:11.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 0x7fa9c014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 0x7fa9c014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43804/0 (socket says 172.21.15.12:43804) 2024-09-10T09:23:11.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 -- 172.21.15.12:0/3265593423 learned_addr learned my addr 172.21.15.12:0/3265593423 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:11.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bffff640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c00b1980 0x7fa9c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9c4a02640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9c015c690 0x7fa9c015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 -- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c00b1980 msgr2=0x7fa9c006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c00b1980 0x7fa9c006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 -- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9c015c690 msgr2=0x7fa9c015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:11.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9c015c690 0x7fa9c015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:11.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bf7fe640 1 -- 172.21.15.12:0/3265593423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c006ecb0 con 0x7fa9c00b4290 2024-09-10T09:23:11.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.836+0000 7fa9bffff640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c00b1980 0x7fa9c006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:11.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.837+0000 7fa9bf7fe640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 0x7fa9c014e240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c3e0 tx=0x7fa9b400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.837+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4017070 con 0x7fa9c00b4290 2024-09-10T09:23:11.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.837+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4005ce0 con 0x7fa9c00b4290 2024-09-10T09:23:11.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.837+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c006cd50 con 0x7fa9c00b4290 2024-09-10T09:23:11.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.837+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40072d0 con 0x7fa9c00b4290 2024-09-10T09:23:11.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.837+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c006d310 con 0x7fa9c00b4290 2024-09-10T09:23:11.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.838+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c00b6010 con 0x7fa9c00b4290 2024-09-10T09:23:11.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.838+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9b401a070 con 0x7fa9c00b4290 2024-09-10T09:23:11.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.839+0000 7fa9bcff9640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:11.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.839+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fa9b4089dc0 con 0x7fa9c00b4290 2024-09-10T09:23:11.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.839+0000 7fa9bffff640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:11.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.839+0000 7fa9bffff640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0034000 tx=0x7fa9b002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:11.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:11.843+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9c006ecb0 con 0x7fa9c00b4290 2024-09-10T09:23:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.020+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa9c00b4990 con 0x7fa9c00b4290 2024-09-10T09:23:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.020+0000 7fa9bcff9640 1 -- 172.21.15.12:0/3265593423 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fa9b4058470 con 0x7fa9c00b4290 2024-09-10T09:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-10T09:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-10T09:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-10T09:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:12.022 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-10T09:23:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9ac06be30 msgr2=0x7fa9ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:12.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0034000 tx=0x7fa9b002e000 comp rx=0 tx=0).stop 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 msgr2=0x7fa9c014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 0x7fa9c014e240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c3e0 tx=0x7fa9b400c8a0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 shutdown_connections 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa9ac06be30 0x7fa9ac06e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9c015c690 0x7fa9c015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9c00b4290 0x7fa9c014e240 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 --2- 172.21.15.12:0/3265593423 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa9c00b1980 0x7fa9c006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 >> 172.21.15.12:0/3265593423 conn(0x7fa9c0062630 msgr2=0x7fa9c00b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 shutdown_connections 2024-09-10T09:23:12.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.022+0000 7fa9c6465640 1 -- 172.21.15.12:0/3265593423 wait complete. 2024-09-10T09:23:12.034 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T09:23:12.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T09:23:12.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.141+0000 7f96c23ef640 1 Processor -- start 2024-09-10T09:23:12.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.142+0000 7f96c23ef640 1 -- start start 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.142+0000 7f96c23ef640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96bc0b3540 0x7f96bc0d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.142+0000 7f96c23ef640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc0d20e0 con 0x7f96bc0b3b00 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.142+0000 7f96c23ef640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc0cfa70 con 0x7f96bc0b61e0 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.142+0000 7f96c23ef640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc0d24f0 con 0x7f96bc0b3540 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96c098c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96bc0b3540 0x7f96bc0d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96b3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f96bc0b3b00 0x7f96bc0d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36728/0 (socket says 172.21.15.12:36728) 2024-09-10T09:23:12.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96b3fff640 1 -- 172.21.15.12:0/4142695168 learned_addr learned my addr 172.21.15.12:0/4142695168 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:12.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96c098c640 1 -- 172.21.15.12:0/4142695168 >> v1:172.21.15.100:6789/0 conn(0x7f96bc0b61e0 legacy=0x7f96bc0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:12.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96c098c640 1 -- 172.21.15.12:0/4142695168 >> v1:172.21.15.12:6789/0 conn(0x7f96bc0b3b00 legacy=0x7f96bc0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:12.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96c098c640 1 -- 172.21.15.12:0/4142695168 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc0cfd50 con 0x7f96bc0b3540 2024-09-10T09:23:12.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.143+0000 7f96bb7fe640 1 -- 172.21.15.12:0/4142695168 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873624997 0 0) 0x7f96bc0d20e0 con 0x7f96bc0b3b00 2024-09-10T09:23:12.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c098c640 1 --2- 172.21.15.12:0/4142695168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0d3090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009d90 tx=0x7f96b402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1ef25bcb1a429 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:12.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96bb7fe640 1 -- 172.21.15.12:0/4142695168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4007740 con 0x7f96bc0b3540 2024-09-10T09:23:12.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96bb7fe640 1 -- 172.21.15.12:0/4142695168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b40078e0 con 0x7f96bc0b3540 2024-09-10T09:23:12.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96bb7fe640 1 -- 172.21.15.12:0/4142695168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4007cb0 con 0x7f96bc0b3540 2024-09-10T09:23:12.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 -- 172.21.15.12:0/4142695168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 msgr2=0x7f96bc0d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:12.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 --2- 172.21.15.12:0/4142695168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0d3090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009d90 tx=0x7f96b402a580 comp rx=0 tx=0).stop 2024-09-10T09:23:12.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 -- 172.21.15.12:0/4142695168 shutdown_connections 2024-09-10T09:23:12.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 --2- 172.21.15.12:0/4142695168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0d3090 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 -- 172.21.15.12:0/4142695168 >> 172.21.15.12:0/4142695168 conn(0x7f96bc0d11e0 msgr2=0x7f96bc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:12.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 -- 172.21.15.12:0/4142695168 shutdown_connections 2024-09-10T09:23:12.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.144+0000 7f96c23ef640 1 -- 172.21.15.12:0/4142695168 wait complete. 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 Processor -- start 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 -- start start 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0b3b00 0x7f96bc1e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc0b61e0 0x7f96bc145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc15edc0 con 0x7f96bc0b3540 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc0d1d00 con 0x7f96bc0b3b00 2024-09-10T09:23:12.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96c23ef640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc144be0 con 0x7f96bc0b61e0 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43824/0 (socket says 172.21.15.12:43824) 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.146+0000 7f96bbfff640 1 -- 172.21.15.12:0/1848529799 learned_addr learned my addr 172.21.15.12:0/1848529799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96b3fff640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0b3b00 0x7f96bc1e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96c098c640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc0b61e0 0x7f96bc145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96bbfff640 1 -- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc0b61e0 msgr2=0x7f96bc145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96bbfff640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc0b61e0 0x7f96bc145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96bbfff640 1 -- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0b3b00 msgr2=0x7f96bc1e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96bbfff640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0b3b00 0x7f96bc1e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96bbfff640 1 -- 172.21.15.12:0/1848529799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc144ec0 con 0x7f96bc0b3540 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96c098c640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc0b61e0 0x7f96bc145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96bbfff640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0cbe20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00b3f0 tx=0x7f96ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac015020 con 0x7f96bc0b3540 2024-09-10T09:23:12.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac011830 con 0x7f96bc0b3540 2024-09-10T09:23:12.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc1451a0 con 0x7f96bc0b3540 2024-09-10T09:23:12.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac011c20 con 0x7f96bc0b3540 2024-09-10T09:23:12.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.147+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc1e8d90 con 0x7f96bc0b3540 2024-09-10T09:23:12.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.148+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96bc0b65c0 con 0x7f96bc0b3540 2024-09-10T09:23:12.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.148+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96ac018020 con 0x7f96bc0b3540 2024-09-10T09:23:12.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.149+0000 7f96b97fa640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f969c06be30 0x7f969c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:12.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.149+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f96ac08a9e0 con 0x7f96bc0b3540 2024-09-10T09:23:12.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.149+0000 7f96b3fff640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f969c06be30 0x7f969c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:12.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.150+0000 7f96b3fff640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f969c06be30 0x7f969c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96bc144a10 tx=0x7f96a4007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:12.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.154+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96ac01f020 con 0x7f96bc0b3540 2024-09-10T09:23:12.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:12.331+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f96bc0b6d80 con 0x7f96bc0b3540 2024-09-10T09:23:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.067+0000 7f96b97fa640 1 -- 172.21.15.12:0/1848529799 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f96ac059770 con 0x7f96bc0b3540 2024-09-10T09:23:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-10T09:23:13.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f969c06be30 msgr2=0x7f969c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:13.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f969c06be30 0x7f969c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96bc144a10 tx=0x7f96a4007de0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 msgr2=0x7f96bc0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0cbe20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00b3f0 tx=0x7f96ac00b8b0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 shutdown_connections 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f969c06be30 0x7f969c06e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc0b61e0 0x7f96bc145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0b3b00 0x7f96bc1e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 --2- 172.21.15.12:0/1848529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96bc0b3540 0x7f96bc0cbe20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.070+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 >> 172.21.15.12:0/1848529799 conn(0x7f96bc0d11e0 msgr2=0x7f96bc0d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.071+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 shutdown_connections 2024-09-10T09:23:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.071+0000 7f96c23ef640 1 -- 172.21.15.12:0/1848529799 wait complete. 2024-09-10T09:23:13.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T09:23:13.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.205+0000 7f5a65667640 1 Processor -- start 2024-09-10T09:23:13.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.205+0000 7f5a65667640 1 -- start start 2024-09-10T09:23:13.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a65667640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a6015eb10 0x7f5a6006ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a65667640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a600b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a65667640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a600711a0 con 0x7f5a60070d30 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a65667640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5a600b5be0 con 0x7f5a6015eb10 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a65667640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6006e5d0 con 0x7f5a600d2c00 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a5e7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5a60070d30 0x7f5a600d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38994/0 (socket says 172.21.15.12:38994) 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a5e7fc640 1 -- 172.21.15.12:0/3218199904 learned_addr learned my addr 172.21.15.12:0/3218199904 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a5effd640 1 --2- 172.21.15.12:0/3218199904 >> v2:172.21.15.100:3300/0 conn(0x7f5a6015eb10 0x7f5a6006ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a5f7fe640 1 --2- 172.21.15.12:0/3218199904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a600b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a5dffb640 1 -- 172.21.15.12:0/3218199904 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408476068 0 0) 0x7f5a600711a0 con 0x7f5a60070d30 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.206+0000 7f5a5dffb640 1 -- 172.21.15.12:0/3218199904 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a4c003520 con 0x7f5a60070d30 2024-09-10T09:23:13.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5f7fe640 1 -- 172.21.15.12:0/3218199904 >> v2:172.21.15.100:3300/0 conn(0x7f5a6015eb10 msgr2=0x7f5a6006ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:13.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5f7fe640 1 --2- 172.21.15.12:0/3218199904 >> v2:172.21.15.100:3300/0 conn(0x7f5a6015eb10 0x7f5a6006ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5f7fe640 1 -- 172.21.15.12:0/3218199904 >> v1:172.21.15.12:6789/0 conn(0x7f5a60070d30 legacy=0x7f5a600d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:13.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5dffb640 1 -- 172.21.15.12:0/3218199904 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 394104232 0 0) 0x7f5a4c003520 con 0x7f5a60070d30 2024-09-10T09:23:13.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5f7fe640 1 -- 172.21.15.12:0/3218199904 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a60071760 con 0x7f5a600d2c00 2024-09-10T09:23:13.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5effd640 1 --2- 172.21.15.12:0/3218199904 >> v2:172.21.15.100:3300/0 conn(0x7f5a6015eb10 0x7f5a6006ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:13.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.207+0000 7f5a5f7fe640 1 --2- 172.21.15.12:0/3218199904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a600b56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a580097a0 tx=0x7f5a5802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c75e1fbecb9a277 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:13.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a5dffb640 1 -- 172.21.15.12:0/3218199904 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58037070 con 0x7f5a600d2c00 2024-09-10T09:23:13.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a5dffb640 1 -- 172.21.15.12:0/3218199904 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5802aba0 con 0x7f5a600d2c00 2024-09-10T09:23:13.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a5dffb640 1 -- 172.21.15.12:0/3218199904 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48001670 con 0x7f5a600d2c00 2024-09-10T09:23:13.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 -- 172.21.15.12:0/3218199904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 msgr2=0x7f5a600b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 --2- 172.21.15.12:0/3218199904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a600b56a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a580097a0 tx=0x7f5a5802a110 comp rx=0 tx=0).stop 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 -- 172.21.15.12:0/3218199904 shutdown_connections 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 --2- 172.21.15.12:0/3218199904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a600b56a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 --2- 172.21.15.12:0/3218199904 >> v2:172.21.15.100:3300/0 conn(0x7f5a6015eb10 0x7f5a6006ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 -- 172.21.15.12:0/3218199904 >> 172.21.15.12:0/3218199904 conn(0x7f5a6006f370 msgr2=0x7f5a6006f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 -- 172.21.15.12:0/3218199904 shutdown_connections 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.208+0000 7f5a65667640 1 -- 172.21.15.12:0/3218199904 wait complete. 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 Processor -- start 2024-09-10T09:23:13.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 -- start start 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 0x7f5a6014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a6015ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a6015eb10 0x7f5a6015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6006eb00 con 0x7f5a60070d30 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6006e820 con 0x7f5a6015eb10 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a65667640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6015f210 con 0x7f5a600d2c00 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a5effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 0x7f5a6014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:13.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a5effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 0x7f5a6014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54800/0 (socket says 172.21.15.12:54800) 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.210+0000 7f5a5effd640 1 -- 172.21.15.12:0/178518252 learned_addr learned my addr 172.21.15.12:0/178518252 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5e7fc640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a6015ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5f7fe640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a6015eb10 0x7f5a6015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5effd640 1 -- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 msgr2=0x7f5a6015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5effd640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a6015ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5effd640 1 -- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a6015eb10 msgr2=0x7f5a6015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5effd640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a6015eb10 0x7f5a6015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5effd640 1 -- 172.21.15.12:0/178518252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6014e150 con 0x7f5a60070d30 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a5effd640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 0x7f5a6014b9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ec0 tx=0x7f5a5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50018020 con 0x7f5a60070d30 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50014680 con 0x7f5a60070d30 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a60160e90 con 0x7f5a60070d30 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50014a50 con 0x7f5a60070d30 2024-09-10T09:23:13.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.211+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a600d13b0 con 0x7f5a60070d30 2024-09-10T09:23:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.212+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a600b56a0 con 0x7f5a60070d30 2024-09-10T09:23:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.213+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a50005d10 con 0x7f5a60070d30 2024-09-10T09:23:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.214+0000 7f5a577fe640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5a4006be60 0x7f5a4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:13.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.214+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f5a5008b890 con 0x7f5a60070d30 2024-09-10T09:23:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.214+0000 7f5a5e7fc640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5a4006be60 0x7f5a4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:13.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.214+0000 7f5a5e7fc640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5a4006be60 0x7f5a4006e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a6015b7d0 tx=0x7f5a480057f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:13.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.218+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a50022030 con 0x7f5a60070d30 2024-09-10T09:23:13.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:13.395+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5a60069160 con 0x7f5a60070d30 2024-09-10T09:23:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.070+0000 7f5a577fe640 1 -- 172.21.15.12:0/178518252 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f5a50010040 con 0x7f5a60070d30 2024-09-10T09:23:14.071 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5a4006be60 msgr2=0x7f5a4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5a4006be60 0x7f5a4006e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a6015b7d0 tx=0x7f5a480057f0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 msgr2=0x7f5a6014b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 0x7f5a6014b9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ec0 tx=0x7f5a5000c490 comp rx=0 tx=0).stop 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 shutdown_connections 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f5a4006be60 0x7f5a4006e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a6015eb10 0x7f5a6015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5a600d2c00 0x7f5a6015ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 --2- 172.21.15.12:0/178518252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a60070d30 0x7f5a6014b9b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 >> 172.21.15.12:0/178518252 conn(0x7f5a6006f370 msgr2=0x7f5a6015d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 shutdown_connections 2024-09-10T09:23:14.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.073+0000 7f5a65667640 1 -- 172.21.15.12:0/178518252 wait complete. 2024-09-10T09:23:14.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T09:23:14.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.213+0000 7f8d66dfd640 1 Processor -- start 2024-09-10T09:23:14.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.213+0000 7f8d66dfd640 1 -- start start 2024-09-10T09:23:14.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d66dfd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d66dfd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d600b3890 0x7f8d600d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d66dfd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d600ced80 0x7f8d6006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d66dfd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8d600d2e60 con 0x7f8d600b3890 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d66dfd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8d600d4390 con 0x7f8d600ced80 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d66dfd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8d600cf740 con 0x7f8d600d3a70 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d5ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d600b3890 0x7f8d600d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d5ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d600b3890 0x7f8d600d3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54816/0 (socket says 172.21.15.12:54816) 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d5ffff640 1 -- 172.21.15.12:0/109545386 learned_addr learned my addr 172.21.15.12:0/109545386 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d64b99640 1 --2- 172.21.15.12:0/109545386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.214+0000 7f8d6539a640 1 --2- 172.21.15.12:0/109545386 >> v2:172.21.15.100:3300/0 conn(0x7f8d600ced80 0x7f8d6006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5ffff640 1 -- 172.21.15.12:0/109545386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 msgr2=0x7f8d600d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5ffff640 1 --2- 172.21.15.12:0/109545386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5ffff640 1 -- 172.21.15.12:0/109545386 >> v2:172.21.15.100:3300/0 conn(0x7f8d600ced80 msgr2=0x7f8d6006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5ffff640 1 --2- 172.21.15.12:0/109545386 >> v2:172.21.15.100:3300/0 conn(0x7f8d600ced80 0x7f8d6006bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5ffff640 1 -- 172.21.15.12:0/109545386 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600cfa20 con 0x7f8d600b3890 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d6539a640 1 --2- 172.21.15.12:0/109545386 >> v2:172.21.15.100:3300/0 conn(0x7f8d600ced80 0x7f8d6006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5ffff640 1 --2- 172.21.15.12:0/109545386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600d3e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d600cb790 tx=0x7f8d5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341633ef6aff4a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:14.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.215+0000 7f8d5f7fe640 1 -- 172.21.15.12:0/109545386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54037070 con 0x7f8d600b3890 2024-09-10T09:23:14.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d5f7fe640 1 -- 172.21.15.12:0/109545386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54032440 con 0x7f8d600b3890 2024-09-10T09:23:14.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d5f7fe640 1 -- 172.21.15.12:0/109545386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54032810 con 0x7f8d600b3890 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 -- 172.21.15.12:0/109545386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 msgr2=0x7f8d600d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/109545386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600d3e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d600cb790 tx=0x7f8d5402a1e0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 -- 172.21.15.12:0/109545386 shutdown_connections 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/109545386 >> v2:172.21.15.100:3300/0 conn(0x7f8d600ced80 0x7f8d6006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/109545386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600d3e50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/109545386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 -- 172.21.15.12:0/109545386 >> 172.21.15.12:0/109545386 conn(0x7f8d60062c60 msgr2=0x7f8d600d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 -- 172.21.15.12:0/109545386 shutdown_connections 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.216+0000 7f8d66dfd640 1 -- 172.21.15.12:0/109545386 wait complete. 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.217+0000 7f8d66dfd640 1 Processor -- start 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.217+0000 7f8d66dfd640 1 -- start start 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d66dfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d66dfd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d600ced80 0x7f8d60150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d66dfd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d66dfd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600cf230 con 0x7f8d600b3890 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d66dfd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600d2af0 con 0x7f8d600ced80 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d66dfd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8d600cf3b0 con 0x7f8d600d3a70 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d64b99640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d64b99640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54828/0 (socket says 172.21.15.12:54828) 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d64b99640 1 -- 172.21.15.12:0/4140142234 learned_addr learned my addr 172.21.15.12:0/4140142234 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:14.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.218+0000 7f8d5ffff640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d600ced80 0x7f8d60150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d6539a640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d64b99640 1 -- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 msgr2=0x7f8d600c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d64b99640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d64b99640 1 -- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d600ced80 msgr2=0x7f8d60150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d64b99640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d600ced80 0x7f8d60150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d64b99640 1 -- 172.21.15.12:0/4140142234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d601511b0 con 0x7f8d600b3890 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d64b99640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600c8c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000d620 tx=0x7f8d5000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000b620 con 0x7f8d600b3890 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d50019070 con 0x7f8d600b3890 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000ba00 con 0x7f8d600b3890 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d600b98e0 con 0x7f8d600b3890 2024-09-10T09:23:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.219+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6015bea0 con 0x7f8d600b3890 2024-09-10T09:23:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.220+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d600d3e50 con 0x7f8d600b3890 2024-09-10T09:23:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.221+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d5000bba0 con 0x7f8d600b3890 2024-09-10T09:23:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.221+0000 7f8d5d7fa640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8d4c06be30 0x7f8d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.221+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f8d5008b0b0 con 0x7f8d600b3890 2024-09-10T09:23:14.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.221+0000 7f8d5ffff640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8d4c06be30 0x7f8d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:14.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.222+0000 7f8d5ffff640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8d4c06be30 0x7f8d4c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d54034000 tx=0x7f8d5402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:14.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.226+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d50059470 con 0x7f8d600b3890 2024-09-10T09:23:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:14.437+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8d600cbe60 con 0x7f8d600b3890 2024-09-10T09:23:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.101+0000 7f8d5d7fa640 1 -- 172.21.15.12:0/4140142234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f8d5005d770 con 0x7f8d600b3890 2024-09-10T09:23:15.102 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 4 and data pool 5 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.109+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8d4c06be30 msgr2=0x7f8d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.109+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8d4c06be30 0x7f8d4c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d54034000 tx=0x7f8d5402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.109+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 msgr2=0x7f8d600c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.109+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600c8c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000d620 tx=0x7f8d5000dae0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 shutdown_connections 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8d4c06be30 0x7f8d4c06e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8d600d3a70 0x7f8d600c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d600ced80 0x7f8d60150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 --2- 172.21.15.12:0/4140142234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d600b3890 0x7f8d600c8c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 >> 172.21.15.12:0/4140142234 conn(0x7f8d60062c60 msgr2=0x7f8d600b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 shutdown_connections 2024-09-10T09:23:15.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.110+0000 7f8d66dfd640 1 -- 172.21.15.12:0/4140142234 wait complete. 2024-09-10T09:23:15.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 Processor -- start 2024-09-10T09:23:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 -- start start 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d5415ed20 0x7f4d540b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d540b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d540b7170 con 0x7f4d5415e940 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4d540b7aa0 con 0x7f4d5415ed20 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.240+0000 7f4d59e1e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540d3660 con 0x7f4d540cef90 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d5415ed20 0x7f4d540b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d5415ed20 0x7f4d540b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54834/0 (socket says 172.21.15.12:54834) 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 -- 172.21.15.12:0/312068123 learned_addr learned my addr 172.21.15.12:0/312068123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d53fff640 1 --2- 172.21.15.12:0/312068123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d540b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 -- 172.21.15.12:0/312068123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 msgr2=0x7f4d540b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 --2- 172.21.15.12:0/312068123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d540b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 -- 172.21.15.12:0/312068123 >> v1:172.21.15.100:6789/0 conn(0x7f4d5415e940 legacy=0x7f4d540d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.241+0000 7f4d52ffd640 1 -- 172.21.15.12:0/312068123 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540d3940 con 0x7f4d5415ed20 2024-09-10T09:23:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d52ffd640 1 --2- 172.21.15.12:0/312068123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415ed20 0x7f4d540b3220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009870 tx=0x7f4d4802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9086fdacdb137e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d527fc640 1 -- 172.21.15.12:0/312068123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48037070 con 0x7f4d5415ed20 2024-09-10T09:23:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d527fc640 1 -- 172.21.15.12:0/312068123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4802ae50 con 0x7f4d5415ed20 2024-09-10T09:23:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d527fc640 1 -- 172.21.15.12:0/312068123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48032860 con 0x7f4d5415ed20 2024-09-10T09:23:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 -- 172.21.15.12:0/312068123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415ed20 msgr2=0x7f4d540b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/312068123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415ed20 0x7f4d540b3220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009870 tx=0x7f4d4802a300 comp rx=0 tx=0).stop 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 -- 172.21.15.12:0/312068123 shutdown_connections 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/312068123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415ed20 0x7f4d540b3220 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/312068123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d540b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 -- 172.21.15.12:0/312068123 >> 172.21.15.12:0/312068123 conn(0x7f4d540b6240 msgr2=0x7f4d540b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 -- 172.21.15.12:0/312068123 shutdown_connections 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.242+0000 7f4d59e1e640 1 -- 172.21.15.12:0/312068123 wait complete. 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.244+0000 7f4d59e1e640 1 Processor -- start 2024-09-10T09:23:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.244+0000 7f4d59e1e640 1 -- start start 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d541f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 0x7f4d540ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5415ed20 0x7f4d5415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540d3310 con 0x7f4d5415e940 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540d3f00 con 0x7f4d5415ed20 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540d1ef0 con 0x7f4d540cef90 2024-09-10T09:23:15.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 0x7f4d540ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 0x7f4d540ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54840/0 (socket says 172.21.15.12:54840) 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 -- 172.21.15.12:0/1821469106 learned_addr learned my addr 172.21.15.12:0/1821469106 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d537fe640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d541f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d53fff640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5415ed20 0x7f4d5415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 -- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 msgr2=0x7f4d541f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d541f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 -- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5415ed20 msgr2=0x7f4d5415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5415ed20 0x7f4d5415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 -- 172.21.15.12:0/1821469106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d54158dc0 con 0x7f4d5415e940 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d52ffd640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 0x7f4d540ab1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000c00 tx=0x7f4d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48041070 con 0x7f4d5415e940 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4803c660 con 0x7f4d5415e940 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d541590a0 con 0x7f4d5415e940 2024-09-10T09:23:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.245+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48037040 con 0x7f4d5415e940 2024-09-10T09:23:15.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.246+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d54159660 con 0x7f4d5415e940 2024-09-10T09:23:15.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.246+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d540d1060 con 0x7f4d5415e940 2024-09-10T09:23:15.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.247+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d48044070 con 0x7f4d5415e940 2024-09-10T09:23:15.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.247+0000 7f4d3bfff640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d4006be30 0x7f4d4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.247+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f4d480ab430 con 0x7f4d5415e940 2024-09-10T09:23:15.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.248+0000 7f4d537fe640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d4006be30 0x7f4d4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.248+0000 7f4d537fe640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d4006be30 0x7f4d4006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d44001780 tx=0x7f4d44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.252+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d48079790 con 0x7f4d5415e940 2024-09-10T09:23:15.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.428+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d540ba6b0 con 0x7f4d5415e940 2024-09-10T09:23:15.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.429+0000 7f4d3bfff640 1 -- 172.21.15.12:0/1821469106 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16754 (secure 0 0 0) 0x7f4d4807da90 con 0x7f4d5415e940 2024-09-10T09:23:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:15.430 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:14.438272+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:23:12.362255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T09:23:13.425491+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:15.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d4006be30 msgr2=0x7f4d4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d4006be30 0x7f4d4006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d44001780 tx=0x7f4d44009040 comp rx=0 tx=0).stop 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 msgr2=0x7f4d540ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 0x7f4d540ab1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000c00 tx=0x7f4d480046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 shutdown_connections 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4d4006be30 0x7f4d4006e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5415ed20 0x7f4d5415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d5415e940 0x7f4d540ab1a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 --2- 172.21.15.12:0/1821469106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d540cef90 0x7f4d541f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 >> 172.21.15.12:0/1821469106 conn(0x7f4d540b6240 msgr2=0x7f4d54160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 shutdown_connections 2024-09-10T09:23:15.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.431+0000 7f4d59e1e640 1 -- 172.21.15.12:0/1821469106 wait complete. 2024-09-10T09:23:15.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:15.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.545+0000 7f9c019e4640 1 Processor -- start 2024-09-10T09:23:15.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.545+0000 7f9c019e4640 1 -- start start 2024-09-10T09:23:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9c019e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc0b61f0 0x7f9bfc0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9c019e4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9bfc0b7aa0 0x7f9bfc0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9c019e4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc0b6b50 con 0x7f9bfc15e860 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9c019e4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9bfc0d34d0 con 0x7f9bfc0b7aa0 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9c019e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc0d3790 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9bfaffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9bfc15e860 0x7f9bfc0cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38998/0 (socket says 172.21.15.12:38998) 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9bfaffd640 1 -- 172.21.15.12:0/2454529254 learned_addr learned my addr 172.21.15.12:0/2454529254 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/2454529254 >> v2:172.21.15.100:3300/0 conn(0x7f9bfc0b7aa0 0x7f9bfc0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9bfa7fc640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc0b61f0 0x7f9bfc0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9bf9ffb640 1 -- 172.21.15.12:0/2454529254 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763219220 0 0) 0x7f9bfc0b6b50 con 0x7f9bfc15e860 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.546+0000 7f9bf9ffb640 1 -- 172.21.15.12:0/2454529254 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be4003520 con 0x7f9bfc15e860 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.547+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc0b61f0 msgr2=0x7f9bfc0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.547+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc0b61f0 0x7f9bfc0b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.547+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/2454529254 >> v1:172.21.15.12:6789/0 conn(0x7f9bfc15e860 legacy=0x7f9bfc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.547+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/2454529254 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc0d3a70 con 0x7f9bfc0b7aa0 2024-09-10T09:23:15.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.547+0000 7f9bfa7fc640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc0b61f0 0x7f9bfc0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:15.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.547+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc0b7ef0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009d90 tx=0x7f9bf402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521d7568cf9a062e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9bf9ffb640 1 -- 172.21.15.12:0/2454529254 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4007740 con 0x7f9bfc0b7aa0 2024-09-10T09:23:15.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9bf9ffb640 1 -- 172.21.15.12:0/2454529254 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf40078e0 con 0x7f9bfc0b7aa0 2024-09-10T09:23:15.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9bf9ffb640 1 -- 172.21.15.12:0/2454529254 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4007cb0 con 0x7f9bfc0b7aa0 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 -- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 msgr2=0x7f9bfc0b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc0b7ef0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009d90 tx=0x7f9bf402a6f0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 -- 172.21.15.12:0/2454529254 shutdown_connections 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc0b7ef0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 --2- 172.21.15.12:0/2454529254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc0b61f0 0x7f9bfc0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 -- 172.21.15.12:0/2454529254 >> 172.21.15.12:0/2454529254 conn(0x7f9bfc062c60 msgr2=0x7f9bfc0d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 -- 172.21.15.12:0/2454529254 shutdown_connections 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.548+0000 7f9c019e4640 1 -- 172.21.15.12:0/2454529254 wait complete. 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.549+0000 7f9c019e4640 1 Processor -- start 2024-09-10T09:23:15.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 -- start start 2024-09-10T09:23:15.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 0x7f9bfc1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc1f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc15e860 0x7f9bfc1f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0d4310 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0d4030 con 0x7f9bfc0b7aa0 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9c019e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc15ec40 con 0x7f9bfc15e860 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9bfaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 0x7f9bfc1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9bfaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 0x7f9bfc1f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54850/0 (socket says 172.21.15.12:54850) 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9bfaffd640 1 -- 172.21.15.12:0/1297787048 learned_addr learned my addr 172.21.15.12:0/1297787048 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9bfa7fc640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc1f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.550+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc15e860 0x7f9bfc1f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9bfaffd640 1 -- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc15e860 msgr2=0x7f9bfc1f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9bfaffd640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc15e860 0x7f9bfc1f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9bfaffd640 1 -- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 msgr2=0x7f9bfc1f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9bfaffd640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc1f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9bfaffd640 1 -- 172.21.15.12:0/1297787048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc1601c0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9bfaffd640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 0x7f9bfc1f4880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c390 tx=0x7f9bec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec017070 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec005ce0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc1604a0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0072f0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.551+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc160a60 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.552+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bfc0b3ad0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.553+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bec01a070 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.553+0000 7f9be3fff640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9be806be60 0x7f9be806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.553+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9bec08a170 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.553+0000 7f9bfa7fc640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9be806be60 0x7f9be806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.554+0000 7f9bfa7fc640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9be806be60 0x7f9be806e320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009560 tx=0x7f9bf0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.558+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bec0584d0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.734+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bfc0d2700 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.735+0000 7f9be3fff640 1 -- 172.21.15.12:0/1297787048 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16754 (secure 0 0 0) 0x7f9bec05c7d0 con 0x7f9bfc0b61f0 2024-09-10T09:23:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:15.736 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:14.438272+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:23:12.362255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T09:23:13.425491+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9be806be60 msgr2=0x7f9be806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9be806be60 0x7f9be806e320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009560 tx=0x7f9bf0009190 comp rx=0 tx=0).stop 2024-09-10T09:23:15.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 msgr2=0x7f9bfc1f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 0x7f9bfc1f4880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c390 tx=0x7f9bec00c850 comp rx=0 tx=0).stop 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 shutdown_connections 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9be806be60 0x7f9be806e320 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9bfc15e860 0x7f9bfc1f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9bfc0b7aa0 0x7f9bfc1f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 --2- 172.21.15.12:0/1297787048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bfc0b61f0 0x7f9bfc1f4880 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 >> 172.21.15.12:0/1297787048 conn(0x7f9bfc062c60 msgr2=0x7f9bfc0b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 shutdown_connections 2024-09-10T09:23:15.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.737+0000 7f9c019e4640 1 -- 172.21.15.12:0/1297787048 wait complete. 2024-09-10T09:23:15.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T09:23:15.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.854+0000 7faa5401e640 1 Processor -- start 2024-09-10T09:23:15.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.854+0000 7faa5401e640 1 -- start start 2024-09-10T09:23:15.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa5401e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0d3a70 0x7faa4c0d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa5401e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa4c0b3890 0x7faa4c0d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa5401e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4c0d4390 con 0x7faa4c0ced80 2024-09-10T09:23:15.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa5401e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faa4c0d2e60 con 0x7faa4c0b3890 2024-09-10T09:23:15.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa5401e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7faa4c0cf740 con 0x7faa4c0d3a70 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa515b9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa4c0b3890 0x7faa4c0d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa525bb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faa4c0ced80 0x7faa4c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39004/0 (socket says 172.21.15.12:39004) 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa525bb640 1 -- 172.21.15.12:0/1854641692 learned_addr learned my addr 172.21.15.12:0/1854641692 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.855+0000 7faa51dba640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0d3a70 0x7faa4c0d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa515b9640 1 -- 172.21.15.12:0/1854641692 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0d3a70 msgr2=0x7faa4c0d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa515b9640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0d3a70 0x7faa4c0d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa515b9640 1 -- 172.21.15.12:0/1854641692 >> v1:172.21.15.12:6789/0 conn(0x7faa4c0ced80 legacy=0x7faa4c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa515b9640 1 -- 172.21.15.12:0/1854641692 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c0cfa20 con 0x7faa4c0b3890 2024-09-10T09:23:15.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa50db8640 1 -- 172.21.15.12:0/1854641692 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512830380 0 0) 0x7faa4c0d4390 con 0x7faa4c0ced80 2024-09-10T09:23:15.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa51dba640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0d3a70 0x7faa4c0d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa515b9640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0b3890 0x7faa4c0d3e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0097a0 tx=0x7faa3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73790fe7d4240fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa50db8640 1 -- 172.21.15.12:0/1854641692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c037070 con 0x7faa4c0b3890 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa50db8640 1 -- 172.21.15.12:0/1854641692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa3c032440 con 0x7faa4c0b3890 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.856+0000 7faa50db8640 1 -- 172.21.15.12:0/1854641692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c032810 con 0x7faa4c0b3890 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 -- 172.21.15.12:0/1854641692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0b3890 msgr2=0x7faa4c0d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0b3890 0x7faa4c0d3e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0097a0 tx=0x7faa3c02a180 comp rx=0 tx=0).stop 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 -- 172.21.15.12:0/1854641692 shutdown_connections 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0b3890 0x7faa4c0d3e50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 --2- 172.21.15.12:0/1854641692 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0d3a70 0x7faa4c0d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 -- 172.21.15.12:0/1854641692 >> 172.21.15.12:0/1854641692 conn(0x7faa4c062c60 msgr2=0x7faa4c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:15.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 -- 172.21.15.12:0/1854641692 shutdown_connections 2024-09-10T09:23:15.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.857+0000 7faa5401e640 1 -- 172.21.15.12:0/1854641692 wait complete. 2024-09-10T09:23:15.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.858+0000 7faa5401e640 1 Processor -- start 2024-09-10T09:23:15.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.858+0000 7faa5401e640 1 -- start start 2024-09-10T09:23:15.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa5401e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0b3890 0x7faa4c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa5401e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 0x7faa4c1f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa5401e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4c0d3a70 0x7faa4c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa5401e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c0cf230 con 0x7faa4c0ced80 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa5401e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c0d2af0 con 0x7faa4c0d3a70 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa5401e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7faa4c0cf3b0 con 0x7faa4c0b3890 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa515b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 0x7faa4c1f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa515b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 0x7faa4c1f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54868/0 (socket says 172.21.15.12:54868) 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa515b9640 1 -- 172.21.15.12:0/2041750851 learned_addr learned my addr 172.21.15.12:0/2041750851 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa51dba640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0b3890 0x7faa4c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa525bb640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4c0d3a70 0x7faa4c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa515b9640 1 -- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0b3890 msgr2=0x7faa4c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.859+0000 7faa515b9640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0b3890 0x7faa4c15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa515b9640 1 -- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4c0d3a70 msgr2=0x7faa4c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:15.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa515b9640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4c0d3a70 0x7faa4c15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa515b9640 1 -- 172.21.15.12:0/2041750851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c159b70 con 0x7faa4c0ced80 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa525bb640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4c0d3a70 0x7faa4c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa515b9640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 0x7faa4c1f7cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0097a0 tx=0x7faa3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c037050 con 0x7faa4c0ced80 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa3c038040 con 0x7faa4c0ced80 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c159e50 con 0x7faa4c0ced80 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004470 con 0x7faa4c0ced80 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.860+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c15a410 con 0x7faa4c0ced80 2024-09-10T09:23:15.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.861+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c0d32f0 con 0x7faa4c0ced80 2024-09-10T09:23:15.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.862+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa3c030900 con 0x7faa4c0ced80 2024-09-10T09:23:15.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.862+0000 7faa427fc640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa3006be30 0x7faa3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:15.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.862+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7faa3c0ab960 con 0x7faa4c0ced80 2024-09-10T09:23:15.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.862+0000 7faa51dba640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa3006be30 0x7faa3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:15.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.863+0000 7faa51dba640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa3006be30 0x7faa3006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa48006fd0 tx=0x7faa48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:15.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:15.866+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa3c07a3a0 con 0x7faa4c0ced80 2024-09-10T09:23:16.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.080+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faa4c0b5ca0 con 0x7faa4c0ced80 2024-09-10T09:23:16.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.103+0000 7faa427fc640 1 -- 172.21.15.12:0/2041750851 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7faa3c079ca0 con 0x7faa4c0ced80 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa3006be30 msgr2=0x7faa3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa3006be30 0x7faa3006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa48006fd0 tx=0x7faa48008040 comp rx=0 tx=0).stop 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 msgr2=0x7faa4c1f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 0x7faa4c1f7cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0097a0 tx=0x7faa3c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 shutdown_connections 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa3006be30 0x7faa3006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4c0d3a70 0x7faa4c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa4c0ced80 0x7faa4c1f7cd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 --2- 172.21.15.12:0/2041750851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa4c0b3890 0x7faa4c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 >> 172.21.15.12:0/2041750851 conn(0x7faa4c062c60 msgr2=0x7faa4c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 shutdown_connections 2024-09-10T09:23:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.106+0000 7faa5401e640 1 -- 172.21.15.12:0/2041750851 wait complete. 2024-09-10T09:23:16.118 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T09:23:16.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T09:23:16.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.223+0000 7fee56166640 1 Processor -- start 2024-09-10T09:23:16.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.223+0000 7fee56166640 1 -- start start 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee56166640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee500b5050 0x7fee5015c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee56166640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee500b5500 con 0x7fee5006f130 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee56166640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee500b43f0 con 0x7fee50158e50 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee56166640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fee500b3630 con 0x7fee500b5050 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee4ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee500b5050 0x7fee5015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee4ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee500b5050 0x7fee5015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54882/0 (socket says 172.21.15.12:54882) 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee4ffff640 1 -- 172.21.15.12:0/3941044099 learned_addr learned my addr 172.21.15.12:0/3941044099 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee4ffff640 1 -- 172.21.15.12:0/3941044099 >> v1:172.21.15.100:6789/0 conn(0x7fee50158e50 legacy=0x7fee5006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:16.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee4ffff640 1 -- 172.21.15.12:0/3941044099 >> v1:172.21.15.12:6789/0 conn(0x7fee5006f130 legacy=0x7fee500ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:16.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.224+0000 7fee4ffff640 1 -- 172.21.15.12:0/3941044099 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee500b3910 con 0x7fee500b5050 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.225+0000 7fee4ffff640 1 --2- 172.21.15.12:0/3941044099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee500b5050 0x7fee5015c370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee48009e50 tx=0x7fee4802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f724a66eb1c6b8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.225+0000 7fee4e7fc640 1 -- 172.21.15.12:0/3941044099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480333f0 con 0x7fee500b5050 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.225+0000 7fee4e7fc640 1 -- 172.21.15.12:0/3941044099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee48033590 con 0x7fee500b5050 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.225+0000 7fee4e7fc640 1 -- 172.21.15.12:0/3941044099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48033960 con 0x7fee500b5050 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 -- 172.21.15.12:0/3941044099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee500b5050 msgr2=0x7fee5015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 --2- 172.21.15.12:0/3941044099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee500b5050 0x7fee5015c370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee48009e50 tx=0x7fee4802c8e0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 -- 172.21.15.12:0/3941044099 shutdown_connections 2024-09-10T09:23:16.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 --2- 172.21.15.12:0/3941044099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee500b5050 0x7fee5015c370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 -- 172.21.15.12:0/3941044099 >> 172.21.15.12:0/3941044099 conn(0x7fee5006bba0 msgr2=0x7fee5006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:16.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 -- 172.21.15.12:0/3941044099 shutdown_connections 2024-09-10T09:23:16.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.226+0000 7fee56166640 1 -- 172.21.15.12:0/3941044099 wait complete. 2024-09-10T09:23:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.227+0000 7fee56166640 1 Processor -- start 2024-09-10T09:23:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.227+0000 7fee56166640 1 -- start start 2024-09-10T09:23:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee56166640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 0x7fee50144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee56166640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fee500b5050 0x7fee50144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:16.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee56166640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee50158e50 0x7fee5015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee56166640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee50159230 con 0x7fee5006f130 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee56166640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee500b3ed0 con 0x7fee50158e50 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee56166640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fee500ce910 con 0x7fee500b5050 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 0x7fee50144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 0x7fee50144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54890/0 (socket says 172.21.15.12:54890) 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 -- 172.21.15.12:0/4124225537 learned_addr learned my addr 172.21.15.12:0/4124225537 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4effd640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fee500b5050 0x7fee50144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4ffff640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee50158e50 0x7fee5015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 -- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fee500b5050 msgr2=0x7fee50144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fee500b5050 0x7fee50144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 -- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee50158e50 msgr2=0x7fee5015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee50158e50 0x7fee5015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:16.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4f7fe640 1 -- 172.21.15.12:0/4124225537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee50145430 con 0x7fee5006f130 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.228+0000 7fee4ffff640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee50158e50 0x7fee5015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.229+0000 7fee4f7fe640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 0x7fee50144ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee4000b3e0 tx=0x7fee4000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.229+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40015020 con 0x7fee5006f130 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.229+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40011850 con 0x7fee5006f130 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.229+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40011c40 con 0x7fee5006f130 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.229+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee50144bd0 con 0x7fee5006f130 2024-09-10T09:23:16.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.229+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5015d520 con 0x7fee5006f130 2024-09-10T09:23:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.230+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5015c370 con 0x7fee5006f130 2024-09-10T09:23:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.230+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee40018020 con 0x7fee5006f130 2024-09-10T09:23:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.231+0000 7fee37fff640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fee3c06be30 0x7fee3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:16.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.231+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fee4008adb0 con 0x7fee5006f130 2024-09-10T09:23:16.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.231+0000 7fee4effd640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fee3c06be30 0x7fee3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:16.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.232+0000 7fee4effd640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fee3c06be30 0x7fee3c06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee501f3b40 tx=0x7fee44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:16.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.235+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee4001f020 con 0x7fee5006f130 2024-09-10T09:23:16.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:16.448+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fee50072ea0 con 0x7fee5006f130 2024-09-10T09:23:17.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.104+0000 7fee37fff640 1 -- 172.21.15.12:0/4124225537 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fee400172c0 con 0x7fee5006f130 2024-09-10T09:23:17.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fee3c06be30 msgr2=0x7fee3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fee3c06be30 0x7fee3c06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee501f3b40 tx=0x7fee44009040 comp rx=0 tx=0).stop 2024-09-10T09:23:17.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 msgr2=0x7fee50144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 0x7fee50144ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee4000b3e0 tx=0x7fee4000b8a0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 shutdown_connections 2024-09-10T09:23:17.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fee3c06be30 0x7fee3c06e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee50158e50 0x7fee5015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fee500b5050 0x7fee50144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 --2- 172.21.15.12:0/4124225537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee5006f130 0x7fee50144ef0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.107+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 >> 172.21.15.12:0/4124225537 conn(0x7fee5006bba0 msgr2=0x7fee50071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.108+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 shutdown_connections 2024-09-10T09:23:17.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.108+0000 7fee56166640 1 -- 172.21.15.12:0/4124225537 wait complete. 2024-09-10T09:23:17.124 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T09:23:17.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:17.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.233+0000 7f96e6149640 1 Processor -- start 2024-09-10T09:23:17.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.233+0000 7f96e6149640 1 -- start start 2024-09-10T09:23:17.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96e6149640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96e015e940 0x7f96e00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96e6149640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96e00cef90 0x7f96e00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96e6149640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e00b7170 con 0x7f96e015ed20 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96e6149640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f96e00d1ae0 con 0x7f96e015e940 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96e6149640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f96e00b7aa0 con 0x7f96e00cef90 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96df7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96e015e940 0x7f96e00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96deffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f96e015ed20 0x7f96e00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39032/0 (socket says 172.21.15.12:39032) 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.234+0000 7f96deffd640 1 -- 172.21.15.12:0/1800334286 learned_addr learned my addr 172.21.15.12:0/1800334286 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96dffff640 1 --2- 172.21.15.12:0/1800334286 >> v2:172.21.15.100:3300/0 conn(0x7f96e00cef90 0x7f96e00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96df7fe640 1 -- 172.21.15.12:0/1800334286 >> v2:172.21.15.100:3300/0 conn(0x7f96e00cef90 msgr2=0x7f96e00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96df7fe640 1 --2- 172.21.15.12:0/1800334286 >> v2:172.21.15.100:3300/0 conn(0x7f96e00cef90 0x7f96e00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96df7fe640 1 -- 172.21.15.12:0/1800334286 >> v1:172.21.15.12:6789/0 conn(0x7f96e015ed20 legacy=0x7f96e00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96de7fc640 1 -- 172.21.15.12:0/1800334286 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832246969 0 0) 0x7f96d4001110 con 0x7f96e015ed20 2024-09-10T09:23:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96df7fe640 1 -- 172.21.15.12:0/1800334286 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00d3660 con 0x7f96e015e940 2024-09-10T09:23:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.235+0000 7f96df7fe640 1 --2- 172.21.15.12:0/1800334286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e00d1060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96e006d070 tx=0x7f96d002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b745c97db08b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96de7fc640 1 -- 172.21.15.12:0/1800334286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0007740 con 0x7f96e015e940 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96de7fc640 1 -- 172.21.15.12:0/1800334286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d00078e0 con 0x7f96e015e940 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96de7fc640 1 -- 172.21.15.12:0/1800334286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0007cb0 con 0x7f96e015e940 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 -- 172.21.15.12:0/1800334286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 msgr2=0x7f96e00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 --2- 172.21.15.12:0/1800334286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e00d1060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96e006d070 tx=0x7f96d002a710 comp rx=0 tx=0).stop 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 -- 172.21.15.12:0/1800334286 shutdown_connections 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 --2- 172.21.15.12:0/1800334286 >> v2:172.21.15.100:3300/0 conn(0x7f96e00cef90 0x7f96e00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 --2- 172.21.15.12:0/1800334286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e00d1060 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 -- 172.21.15.12:0/1800334286 >> 172.21.15.12:0/1800334286 conn(0x7f96e00b6240 msgr2=0x7f96e00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 -- 172.21.15.12:0/1800334286 shutdown_connections 2024-09-10T09:23:17.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.236+0000 7f96e6149640 1 -- 172.21.15.12:0/1800334286 wait complete. 2024-09-10T09:23:17.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.237+0000 7f96e6149640 1 Processor -- start 2024-09-10T09:23:17.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 -- start start 2024-09-10T09:23:17.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96e00cef90 0x7f96e015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e01e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e015ed20 0x7f96e01e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00d3f00 con 0x7f96e015e940 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00d3c20 con 0x7f96e015ed20 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.238+0000 7f96e6149640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f96e00d3310 con 0x7f96e00cef90 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e01e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e01e70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54916/0 (socket says 172.21.15.12:54916) 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 -- 172.21.15.12:0/3550478936 learned_addr learned my addr 172.21.15.12:0/3550478936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96df7fe640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96e00cef90 0x7f96e015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96dffff640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e015ed20 0x7f96e01e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 -- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96e00cef90 msgr2=0x7f96e015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96e00cef90 0x7f96e015b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 -- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e015ed20 msgr2=0x7f96e01e7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e015ed20 0x7f96e01e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 -- 172.21.15.12:0/3550478936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e01e9f50 con 0x7f96e015e940 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96deffd640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e01e70d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c750 tx=0x7f96d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4018070 con 0x7f96e015e940 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d40070d0 con 0x7f96e015e940 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40074c0 con 0x7f96e015e940 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e01ea230 con 0x7f96e015e940 2024-09-10T09:23:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.239+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e01ea7f0 con 0x7f96e015e940 2024-09-10T09:23:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.240+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e00d1ef0 con 0x7f96e015e940 2024-09-10T09:23:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.241+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96d401b070 con 0x7f96e015e940 2024-09-10T09:23:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.241+0000 7f96c7fff640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f96cc06be30 0x7f96cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.242+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f96d408a1a0 con 0x7f96e015e940 2024-09-10T09:23:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.242+0000 7f96df7fe640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f96cc06be30 0x7f96cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.242+0000 7f96df7fe640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f96cc06be30 0x7f96cc06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f96d0034000 tx=0x7f96d002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.246+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96e00b7170 con 0x7f96e015e940 2024-09-10T09:23:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.461+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96e00ba6b0 con 0x7f96e015e940 2024-09-10T09:23:17.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.461+0000 7f96c7fff640 1 -- 172.21.15.12:0/3550478936 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5223 (secure 0 0 0) 0x7f96d4058b50 con 0x7f96e015e940 2024-09-10T09:23:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:17.462 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":14,"btime":"2024-09-10T09:23:17:104287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:23:14.438605+0000","modified":"2024-09-10T09:23:16.449169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4714":{"gid":4714,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/694322310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":694322310},{"type":"v1","addr":"172.21.15.100:6836","nonce":694322310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4714,"qdb_cluster":[4714]},"id":2}]} 2024-09-10T09:23:17.462 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 14 2024-09-10T09:23:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f96cc06be30 msgr2=0x7f96cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f96cc06be30 0x7f96cc06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f96d0034000 tx=0x7f96d002f000 comp rx=0 tx=0).stop 2024-09-10T09:23:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 msgr2=0x7f96e01e70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e01e70d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c750 tx=0x7f96d400cc10 comp rx=0 tx=0).stop 2024-09-10T09:23:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 shutdown_connections 2024-09-10T09:23:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f96cc06be30 0x7f96cc06e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96e015ed20 0x7f96e01e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96e015e940 0x7f96e01e70d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 --2- 172.21.15.12:0/3550478936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96e00cef90 0x7f96e015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 >> 172.21.15.12:0/3550478936 conn(0x7f96e00b6240 msgr2=0x7f96e00b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 shutdown_connections 2024-09-10T09:23:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.463+0000 7f96e6149640 1 -- 172.21.15.12:0/3550478936 wait complete. 2024-09-10T09:23:17.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:17.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.577+0000 7f7c4f513640 1 Processor -- start 2024-09-10T09:23:17.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.578+0000 7f7c4f513640 1 -- start start 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.578+0000 7f7c4f513640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c4815e940 0x7f7c480d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.578+0000 7f7c4f513640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c4815ed20 0x7f7c480d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.578+0000 7f7c4f513640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c480b7170 con 0x7f7c480cef90 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.578+0000 7f7c4f513640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7c480d1ae0 con 0x7f7c4815ed20 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.578+0000 7f7c4f513640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7c480b7aa0 con 0x7f7c4815e940 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4caae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c4815ed20 0x7f7c480d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4dab0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7c480cef90 0x7f7c480b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39048/0 (socket says 172.21.15.12:39048) 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4dab0640 1 -- 172.21.15.12:0/2966306557 learned_addr learned my addr 172.21.15.12:0/2966306557 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4d2af640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c4815e940 0x7f7c480d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4caae640 1 -- 172.21.15.12:0/2966306557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c4815e940 msgr2=0x7f7c480d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c47fff640 1 -- 172.21.15.12:0/2966306557 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775090687 0 0) 0x7f7c38001490 con 0x7f7c480cef90 2024-09-10T09:23:17.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4caae640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c4815e940 0x7f7c480d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4caae640 1 -- 172.21.15.12:0/2966306557 >> v1:172.21.15.12:6789/0 conn(0x7f7c480cef90 legacy=0x7f7c480b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4caae640 1 -- 172.21.15.12:0/2966306557 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c480d3660 con 0x7f7c4815ed20 2024-09-10T09:23:17.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.579+0000 7f7c4d2af640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c4815e940 0x7f7c480d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:17.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4caae640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815ed20 0x7f7c480d15a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0097a0 tx=0x7f7c3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7385c7fa5a02bca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c47fff640 1 -- 172.21.15.12:0/2966306557 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c037070 con 0x7f7c4815ed20 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c47fff640 1 -- 172.21.15.12:0/2966306557 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c032440 con 0x7f7c4815ed20 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c47fff640 1 -- 172.21.15.12:0/2966306557 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c032810 con 0x7f7c4815ed20 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4f513640 1 -- 172.21.15.12:0/2966306557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815ed20 msgr2=0x7f7c480d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815ed20 0x7f7c480d15a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0097a0 tx=0x7f7c3c02a210 comp rx=0 tx=0).stop 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4f513640 1 -- 172.21.15.12:0/2966306557 shutdown_connections 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815ed20 0x7f7c480d15a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2966306557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c4815e940 0x7f7c480d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.580+0000 7f7c4f513640 1 -- 172.21.15.12:0/2966306557 >> 172.21.15.12:0/2966306557 conn(0x7f7c480b6240 msgr2=0x7f7c480b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.581+0000 7f7c4f513640 1 -- 172.21.15.12:0/2966306557 shutdown_connections 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.581+0000 7f7c4f513640 1 -- 172.21.15.12:0/2966306557 wait complete. 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.582+0000 7f7c4f513640 1 Processor -- start 2024-09-10T09:23:17.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.582+0000 7f7c4f513640 1 -- start start 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.582+0000 7f7c4f513640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c480cef90 0x7f7c480ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4f513640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 0x7f7c480ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4f513640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c4815ed20 0x7f7c4814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4f513640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7c480d3f00 con 0x7f7c4815e940 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4f513640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c480d3c20 con 0x7f7c4815ed20 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4f513640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7c480d3310 con 0x7f7c480cef90 2024-09-10T09:23:17.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 0x7f7c480ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 0x7f7c480ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54926/0 (socket says 172.21.15.12:54926) 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 -- 172.21.15.12:0/2475512180 learned_addr learned my addr 172.21.15.12:0/2475512180 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4d2af640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c480cef90 0x7f7c480ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 -- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c480cef90 msgr2=0x7f7c480ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c480cef90 0x7f7c480ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 -- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c4815ed20 msgr2=0x7f7c4814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4dab0640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c4815ed20 0x7f7c4814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c4815ed20 0x7f7c4814ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 -- 172.21.15.12:0/2475512180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c48159030 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4caae640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 0x7f7c480ab6e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c035040 tx=0x7f7c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c037050 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c038040 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c480ce0b0 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.583+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004490 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.584+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c48149230 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.585+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c480d1ef0 con 0x7f7c4815e940 2024-09-10T09:23:17.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.585+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c3c030980 con 0x7f7c4815e940 2024-09-10T09:23:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.586+0000 7f7c45ffb640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7c3406be30 0x7f7c3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.586+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7c3c0abc00 con 0x7f7c4815e940 2024-09-10T09:23:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.586+0000 7f7c4d2af640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7c3406be30 0x7f7c3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.586+0000 7f7c4d2af640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7c3406be30 0x7f7c3406e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c40008850 tx=0x7f7c40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.590+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c3c0b2080 con 0x7f7c4815e940 2024-09-10T09:23:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.766+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c480ba6b0 con 0x7f7c4815e940 2024-09-10T09:23:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.767+0000 7f7c45ffb640 1 -- 172.21.15.12:0/2475512180 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16741 (secure 0 0 0) 0x7f7c48159030 con 0x7f7c4815e940 2024-09-10T09:23:17.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:16.100995+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:23:12.362255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T09:23:13.425491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7c3406be30 msgr2=0x7f7c3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7c3406be30 0x7f7c3406e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c40008850 tx=0x7f7c40008040 comp rx=0 tx=0).stop 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 msgr2=0x7f7c480ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 0x7f7c480ab6e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c035040 tx=0x7f7c3c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 shutdown_connections 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7c3406be30 0x7f7c3406e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c4815ed20 0x7f7c4814ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c4815e940 0x7f7c480ab6e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 --2- 172.21.15.12:0/2475512180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7c480cef90 0x7f7c480ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 >> 172.21.15.12:0/2475512180 conn(0x7f7c480b6240 msgr2=0x7f7c480b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:17.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 shutdown_connections 2024-09-10T09:23:17.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.769+0000 7f7c4f513640 1 -- 172.21.15.12:0/2475512180 wait complete. 2024-09-10T09:23:17.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T09:23:17.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.882+0000 7f1913247640 1 Processor -- start 2024-09-10T09:23:17.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.882+0000 7f1913247640 1 -- start start 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f1913247640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f190c15c510 0x7f190c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f1913247640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 0x7f190c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f1913247640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f190c161090 con 0x7f190c0cf3c0 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f1913247640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f190c0afb20 con 0x7f190c15c510 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f1913247640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f190c06e140 con 0x7f190c0d0d10 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f19117e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 0x7f190c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f1910fe3640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f190c15c510 0x7f190c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f19117e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 0x7f190c06eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:35942/0 (socket says 172.21.15.12:35942) 2024-09-10T09:23:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.883+0000 7f19117e4640 1 -- 172.21.15.12:0/3208120114 learned_addr learned my addr 172.21.15.12:0/3208120114 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.884+0000 7f19117e4640 1 -- 172.21.15.12:0/3208120114 >> v2:172.21.15.100:3300/0 conn(0x7f190c15c510 msgr2=0x7f190c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.884+0000 7f19117e4640 1 --2- 172.21.15.12:0/3208120114 >> v2:172.21.15.100:3300/0 conn(0x7f190c15c510 0x7f190c0cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.884+0000 7f19117e4640 1 -- 172.21.15.12:0/3208120114 >> v1:172.21.15.100:6789/0 conn(0x7f190c0cf3c0 legacy=0x7f190c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.884+0000 7f19117e4640 1 -- 172.21.15.12:0/3208120114 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c06e370 con 0x7f190c0d0d10 2024-09-10T09:23:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.884+0000 7f19117e4640 1 --2- 172.21.15.12:0/3208120114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 0x7f190c06eb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1904009e50 tx=0x7f190402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c5eda75bd62441 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.884+0000 7f190b7fe640 1 -- 172.21.15.12:0/3208120114 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904036070 con 0x7f190c0d0d10 2024-09-10T09:23:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f190b7fe640 1 -- 172.21.15.12:0/3208120114 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1904031600 con 0x7f190c0d0d10 2024-09-10T09:23:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f190b7fe640 1 -- 172.21.15.12:0/3208120114 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040319d0 con 0x7f190c0d0d10 2024-09-10T09:23:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 -- 172.21.15.12:0/3208120114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 msgr2=0x7f190c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 --2- 172.21.15.12:0/3208120114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 0x7f190c06eb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1904009e50 tx=0x7f190402a710 comp rx=0 tx=0).stop 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 -- 172.21.15.12:0/3208120114 shutdown_connections 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 --2- 172.21.15.12:0/3208120114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c0d0d10 0x7f190c06eb30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 --2- 172.21.15.12:0/3208120114 >> v2:172.21.15.100:3300/0 conn(0x7f190c15c510 0x7f190c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 -- 172.21.15.12:0/3208120114 >> 172.21.15.12:0/3208120114 conn(0x7f190c0b2480 msgr2=0x7f190c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 -- 172.21.15.12:0/3208120114 shutdown_connections 2024-09-10T09:23:17.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.885+0000 7f1913247640 1 -- 172.21.15.12:0/3208120114 wait complete. 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.886+0000 7f1913247640 1 Processor -- start 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.886+0000 7f1913247640 1 -- start start 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1913247640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f190c0cf3c0 0x7f190c15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1913247640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 0x7f190c15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1913247640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c15c510 0x7f190c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1913247640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f190c0cf800 con 0x7f190c0d0d10 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1913247640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f190c160b60 con 0x7f190c0cf3c0 2024-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1913247640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f190c06e610 con 0x7f190c15c510 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f190bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 0x7f190c15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f190bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 0x7f190c15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54934/0 (socket says 172.21.15.12:54934) 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f190bfff640 1 -- 172.21.15.12:0/2769505667 learned_addr learned my addr 172.21.15.12:0/2769505667 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f1910fe3640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f190c0cf3c0 0x7f190c15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.887+0000 7f19117e4640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c15c510 0x7f190c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f190bfff640 1 -- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c15c510 msgr2=0x7f190c15eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f190bfff640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c15c510 0x7f190c15eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f190bfff640 1 -- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f190c0cf3c0 msgr2=0x7f190c15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f190bfff640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f190c0cf3c0 0x7f190c15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f190bfff640 1 -- 172.21.15.12:0/2769505667 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c15d360 con 0x7f190c0d0d10 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f1910fe3640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f190c0cf3c0 0x7f190c15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f19117e4640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c15c510 0x7f190c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f190bfff640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 0x7f190c15ca60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18f800c400 tx=0x7f18f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80052d0 con 0x7f190c0d0d10 2024-09-10T09:23:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f8005490 con 0x7f190c0d0d10 2024-09-10T09:23:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c15d640 con 0x7f190c0d0d10 2024-09-10T09:23:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8007260 con 0x7f190c0d0d10 2024-09-10T09:23:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.888+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c15dc00 con 0x7f190c0d0d10 2024-09-10T09:23:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.889+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f190c0cfc20 con 0x7f190c0d0d10 2024-09-10T09:23:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.890+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18f8007400 con 0x7f190c0d0d10 2024-09-10T09:23:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.890+0000 7f19097fa640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.890+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f18f808a2f0 con 0x7f190c0d0d10 2024-09-10T09:23:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.891+0000 7f1910fe3640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.891+0000 7f1910fe3640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f18f006be30 0x7f18f006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f190c0b5b00 tx=0x7f190000f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:17.895+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18f8058650 con 0x7f190c0d0d10 2024-09-10T09:23:18.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.067+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f190c0ccb10 con 0x7f18f006be30 2024-09-10T09:23:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.073+0000 7f19097fa640 1 -- 172.21.15.12:0/2769505667 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237197 (secure 0 0 0) 0x7f190c0ccb10 con 0x7f18f006be30 2024-09-10T09:23:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:18.077 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.075+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f18f006be30 msgr2=0x7f18f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.075+0000 7f1913247640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f18f006be30 0x7f18f006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f190c0b5b00 tx=0x7f190000f040 comp rx=0 tx=0).stop 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.075+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 msgr2=0x7f190c15ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.075+0000 7f1913247640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 0x7f190c15ca60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18f800c400 tx=0x7f18f800c8c0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 shutdown_connections 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f190c15c510 0x7f190c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f190c0d0d10 0x7f190c15ca60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 --2- 172.21.15.12:0/2769505667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f190c0cf3c0 0x7f190c15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 >> 172.21.15.12:0/2769505667 conn(0x7f190c0b2480 msgr2=0x7f190c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:18.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 shutdown_connections 2024-09-10T09:23:18.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.076+0000 7f1913247640 1 -- 172.21.15.12:0/2769505667 wait complete. 2024-09-10T09:23:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-10T09:23:17.230156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219856,"kb_used_data":3560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754864,"statfs":{"total":773094113280,"available":772868980736,"internally_reserved":0,"allocated":3645440,"data_stored":2077712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.155771"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-10T09:23:09.074221+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:09.074221+0000","last_peered":"2024-09-10T09:23:09.074221+0000","last_clean":"2024-09-10T09:23:09.074221+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:09.074221+0000","last_undegraded":"2024-09-10T09:23:09.074221+0000","last_fullsized":"2024-09-10T09:23:09.074221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":901120,"data_stored":702490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":901120,"data_stored":702490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:18.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.229+0000 7f82ba59f640 1 Processor -- start 2024-09-10T09:23:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.229+0000 7f82ba59f640 1 -- start start 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82ba59f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b40cf070 0x7f82b40cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82ba59f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82b4073120 0x7f82b4073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82ba59f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82b40ce740 con 0x7f82b415c180 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82ba59f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f82b4072640 con 0x7f82b4073120 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82ba59f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f82b4072920 con 0x7f82b40cf070 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b8b3c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82b4073120 0x7f82b4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b40cf070 0x7f82b40cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b3fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f82b415c180 0x7f82b40cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:40292/0 (socket says 172.21.15.12:40292) 2024-09-10T09:23:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b3fff640 1 -- 172.21.15.12:0/346250152 learned_addr learned my addr 172.21.15.12:0/346250152 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:18.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b8b3c640 1 -- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b40cf070 msgr2=0x7f82b40cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:18.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b8b3c640 1 --2- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b40cf070 0x7f82b40cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b8b3c640 1 -- 172.21.15.12:0/346250152 >> v1:172.21.15.100:6789/0 conn(0x7f82b415c180 legacy=0x7f82b40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b8b3c640 1 -- 172.21.15.12:0/346250152 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b4072c00 con 0x7f82b4073120 2024-09-10T09:23:18.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.230+0000 7f82b37fe640 1 --2- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b40cf070 0x7f82b40cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.231+0000 7f82b8b3c640 1 --2- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b4073590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009d90 tx=0x7f82ac02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=901a650f295d14e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.231+0000 7f82b2ffd640 1 -- 172.21.15.12:0/346250152 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac031600 con 0x7f82b4073120 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.231+0000 7f82b2ffd640 1 -- 172.21.15.12:0/346250152 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac0317a0 con 0x7f82b4073120 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.231+0000 7f82b2ffd640 1 -- 172.21.15.12:0/346250152 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac031b70 con 0x7f82b4073120 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 -- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 msgr2=0x7f82b4073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 --2- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b4073590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009d90 tx=0x7f82ac02a5d0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 -- 172.21.15.12:0/346250152 shutdown_connections 2024-09-10T09:23:18.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 --2- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b4073590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 --2- 172.21.15.12:0/346250152 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b40cf070 0x7f82b40cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 -- 172.21.15.12:0/346250152 >> 172.21.15.12:0/346250152 conn(0x7f82b4062cc0 msgr2=0x7f82b406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:18.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 -- 172.21.15.12:0/346250152 shutdown_connections 2024-09-10T09:23:18.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.232+0000 7f82ba59f640 1 -- 172.21.15.12:0/346250152 wait complete. 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.233+0000 7f82ba59f640 1 Processor -- start 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.233+0000 7f82ba59f640 1 -- start start 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82ba59f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82ba59f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 0x7f82b414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82ba59f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b415c180 0x7f82b414c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82ba59f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f82b40722f0 con 0x7f82b40cf070 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82ba59f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f82b40ced00 con 0x7f82b4073120 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82ba59f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f82b415c560 con 0x7f82b415c180 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 0x7f82b414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 0x7f82b414bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54940/0 (socket says 172.21.15.12:54940) 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82b37fe640 1 -- 172.21.15.12:0/4094035646 learned_addr learned my addr 172.21.15.12:0/4094035646 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82b3fff640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82b8b3c640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b415c180 0x7f82b414c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.234+0000 7f82b37fe640 1 -- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b415c180 msgr2=0x7f82b414c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b37fe640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b415c180 0x7f82b414c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b37fe640 1 -- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 msgr2=0x7f82b415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b37fe640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b37fe640 1 -- 172.21.15.12:0/4094035646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b40b34e0 con 0x7f82b40cf070 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b8b3c640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b415c180 0x7f82b414c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b37fe640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 0x7f82b414bad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f829c00e960 tx=0x7f829c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c017070 con 0x7f82b40cf070 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c00ca00 con 0x7f82b40cf070 2024-09-10T09:23:18.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c00cdd0 con 0x7f82b40cf070 2024-09-10T09:23:18.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b415b0a0 con 0x7f82b40cf070 2024-09-10T09:23:18.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.235+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b415b660 con 0x7f82b40cf070 2024-09-10T09:23:18.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.236+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b40cf4b0 con 0x7f82b40cf070 2024-09-10T09:23:18.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.236+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f829c01a070 con 0x7f82b40cf070 2024-09-10T09:23:18.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.237+0000 7f82b0ff9640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f829406be30 0x7f829406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.237+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f829c08ad20 con 0x7f82b40cf070 2024-09-10T09:23:18.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.237+0000 7f82b3fff640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f829406be30 0x7f829406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.238+0000 7f82b3fff640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f829406be30 0x7f829406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82a4000f60 tx=0x7f82a4007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.241+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f829c058ff0 con 0x7f82b40cf070 2024-09-10T09:23:18.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.413+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82b406c400 con 0x7f829406be30 2024-09-10T09:23:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.419+0000 7f82b0ff9640 1 -- 172.21.15.12:0/4094035646 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237197 (secure 0 0 0) 0x7f82b406c400 con 0x7f829406be30 2024-09-10T09:23:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:18.423 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f829406be30 msgr2=0x7f829406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f829406be30 0x7f829406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82a4000f60 tx=0x7f82a4007e80 comp rx=0 tx=0).stop 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 msgr2=0x7f82b414bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 0x7f82b414bad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f829c00e960 tx=0x7f829c00ee20 comp rx=0 tx=0).stop 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 shutdown_connections 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f829406be30 0x7f829406e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82b415c180 0x7f82b414c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b40cf070 0x7f82b414bad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 --2- 172.21.15.12:0/4094035646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82b4073120 0x7f82b415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 >> 172.21.15.12:0/4094035646 conn(0x7f82b4062cc0 msgr2=0x7f82b40cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 shutdown_connections 2024-09-10T09:23:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.422+0000 7f82ba59f640 1 -- 172.21.15.12:0/4094035646 wait complete. 2024-09-10T09:23:18.434 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-10T09:23:17.230156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219856,"kb_used_data":3560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754864,"statfs":{"total":773094113280,"available":772868980736,"internally_reserved":0,"allocated":3645440,"data_stored":2077712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.155771"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-10T09:23:09.074221+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:09.074221+0000","last_peered":"2024-09-10T09:23:09.074221+0000","last_clean":"2024-09-10T09:23:09.074221+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:09.074221+0000","last_undegraded":"2024-09-10T09:23:09.074221+0000","last_fullsized":"2024-09-10T09:23:09.074221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":901120,"data_stored":702490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":901120,"data_stored":702490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:18.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:18.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.576+0000 7f464a2a6640 1 Processor -- start 2024-09-10T09:23:18.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.576+0000 7f464a2a6640 1 -- start start 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.577+0000 7f464a2a6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f464415e940 0x7f46440d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.577+0000 7f464a2a6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46440b7170 con 0x7f464415ed20 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.577+0000 7f464a2a6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46440b7aa0 con 0x7f46440cef90 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.577+0000 7f464a2a6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f46440d3660 con 0x7f464415e940 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.577+0000 7f46437fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f464415ed20 0x7f46440b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39054/0 (socket says 172.21.15.12:39054) 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.577+0000 7f46437fe640 1 -- 172.21.15.12:0/3473232877 learned_addr learned my addr 172.21.15.12:0/3473232877 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4643fff640 1 --2- 172.21.15.12:0/3473232877 >> v2:172.21.15.100:3300/0 conn(0x7f464415e940 0x7f46440d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916392893 0 0) 0x7f4638001110 con 0x7f464415ed20 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f462c003520 con 0x7f464415ed20 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564991699 0 0) 0x7f46440b7aa0 con 0x7f46440cef90 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4638001110 con 0x7f46440cef90 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1080860735 0 0) 0x7f462c003520 con 0x7f464415ed20 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4643fff640 1 -- 172.21.15.12:0/3473232877 >> v1:172.21.15.100:6789/0 conn(0x7f46440cef90 legacy=0x7f46440b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4643fff640 1 -- 172.21.15.12:0/3473232877 >> v1:172.21.15.12:6789/0 conn(0x7f464415ed20 legacy=0x7f46440b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.578+0000 7f4643fff640 1 -- 172.21.15.12:0/3473232877 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46440d3940 con 0x7f464415e940 2024-09-10T09:23:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.579+0000 7f4643fff640 1 --2- 172.21.15.12:0/3473232877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415e940 0x7f46440d1060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46340097a0 tx=0x7f463402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85ae445ed192c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.579+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634037070 con 0x7f464415e940 2024-09-10T09:23:18.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.579+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463402ace0 con 0x7f464415e940 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.579+0000 7f4642ffd640 1 -- 172.21.15.12:0/3473232877 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638001840 con 0x7f464415e940 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.579+0000 7f464a2a6640 1 -- 172.21.15.12:0/3473232877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415e940 msgr2=0x7f46440d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.579+0000 7f464a2a6640 1 --2- 172.21.15.12:0/3473232877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415e940 0x7f46440d1060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46340097a0 tx=0x7f463402a250 comp rx=0 tx=0).stop 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.580+0000 7f464a2a6640 1 -- 172.21.15.12:0/3473232877 shutdown_connections 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.580+0000 7f464a2a6640 1 --2- 172.21.15.12:0/3473232877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415e940 0x7f46440d1060 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.580+0000 7f464a2a6640 1 -- 172.21.15.12:0/3473232877 >> 172.21.15.12:0/3473232877 conn(0x7f46440b6240 msgr2=0x7f46440b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.580+0000 7f464a2a6640 1 -- 172.21.15.12:0/3473232877 shutdown_connections 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.580+0000 7f464a2a6640 1 -- 172.21.15.12:0/3473232877 wait complete. 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.581+0000 7f464a2a6640 1 Processor -- start 2024-09-10T09:23:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.581+0000 7f464a2a6640 1 -- start start 2024-09-10T09:23:18.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46440cef90 0x7f4644158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 0x7f46440ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415ed20 0x7f46440ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f46440d3310 con 0x7f464415e940 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46440d3f00 con 0x7f464415ed20 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f46440d1ef0 con 0x7f46440cef90 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 0x7f46440ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 0x7f46440ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54954/0 (socket says 172.21.15.12:54954) 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 -- 172.21.15.12:0/1706669590 learned_addr learned my addr 172.21.15.12:0/1706669590 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f4643fff640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46440cef90 0x7f4644158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f4648843640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415ed20 0x7f46440ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 -- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46440cef90 msgr2=0x7f4644158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46440cef90 0x7f4644158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 -- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415ed20 msgr2=0x7f46440ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415ed20 0x7f46440ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 -- 172.21.15.12:0/1706669590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46440cd2a0 con 0x7f464415e940 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f4648843640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415ed20 0x7f46440ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f46437fe640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 0x7f46440ce2a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f463800c780 tx=0x7f463800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638017070 con 0x7f464415e940 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4638005ce0 con 0x7f464415e940 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46440cd580 con 0x7f464415e940 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638007290 con 0x7f464415e940 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.582+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4644158a50 con 0x7f464415e940 2024-09-10T09:23:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.584+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4644158c50 con 0x7f464415e940 2024-09-10T09:23:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.584+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f463801a070 con 0x7f464415e940 2024-09-10T09:23:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.585+0000 7f4640ff9640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f463006be30 0x7f463006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.585+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f463808a2c0 con 0x7f464415e940 2024-09-10T09:23:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.585+0000 7f4643fff640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f463006be30 0x7f463006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.585+0000 7f4643fff640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f463006be30 0x7f463006e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4634034000 tx=0x7f463402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.589+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4644158c50 con 0x7f464415e940 2024-09-10T09:23:18.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.764+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46440d1060 con 0x7f463006be30 2024-09-10T09:23:18.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.770+0000 7f4640ff9640 1 -- 172.21.15.12:0/1706669590 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237197 (secure 0 0 0) 0x7f46440d1060 con 0x7f463006be30 2024-09-10T09:23:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:18.774 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:18.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f463006be30 msgr2=0x7f463006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f463006be30 0x7f463006e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4634034000 tx=0x7f463402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 msgr2=0x7f46440ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 0x7f46440ce2a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f463800c780 tx=0x7f463800cc40 comp rx=0 tx=0).stop 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 shutdown_connections 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f463006be30 0x7f463006e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f464415ed20 0x7f46440ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f464415e940 0x7f46440ce2a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 --2- 172.21.15.12:0/1706669590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46440cef90 0x7f4644158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.773+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 >> 172.21.15.12:0/1706669590 conn(0x7f46440b6240 msgr2=0x7f46440cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.774+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 shutdown_connections 2024-09-10T09:23:18.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.774+0000 7f464a2a6640 1 -- 172.21.15.12:0/1706669590 wait complete. 2024-09-10T09:23:18.785 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-10T09:23:17.230156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219856,"kb_used_data":3560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754864,"statfs":{"total":773094113280,"available":772868980736,"internally_reserved":0,"allocated":3645440,"data_stored":2077712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.155771"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:14.068354+0000","last_change":"2024-09-10T09:23:14.068354+0000","last_active":"2024-09-10T09:23:14.068354+0000","last_peered":"2024-09-10T09:23:14.068354+0000","last_clean":"2024-09-10T09:23:14.068354+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:14.068354+0000","last_undegraded":"2024-09-10T09:23:14.068354+0000","last_fullsized":"2024-09-10T09:23:14.068354+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T09:23:13.065993+0000","last_change":"2024-09-10T09:23:13.065993+0000","last_active":"2024-09-10T09:23:13.065993+0000","last_peered":"2024-09-10T09:23:13.065993+0000","last_clean":"2024-09-10T09:23:13.065993+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T09:23:13.065993+0000","last_undegraded":"2024-09-10T09:23:13.065993+0000","last_fullsized":"2024-09-10T09:23:13.065993+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-10T09:23:09.074221+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:09.074221+0000","last_peered":"2024-09-10T09:23:09.074221+0000","last_clean":"2024-09-10T09:23:09.074221+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:09.074221+0000","last_undegraded":"2024-09-10T09:23:09.074221+0000","last_fullsized":"2024-09-10T09:23:09.074221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":901120,"data_stored":702490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":307200,"data_stored":112122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":901120,"data_stored":702490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.789 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.790 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-10T09:23:18.791 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.792 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.793 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.794 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.795 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-10T09:23:18.796 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.796 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-10T09:23:18.796 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.796 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-10T09:23:18.796 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.797 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-10T09:23:18.798 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.799 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-10T09:23:18.800 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-10T09:23:18.801 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-10T09:23:18.802 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-10T09:23:18.803 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-10T09:23:18.804 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-10T09:23:18.805 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:14.068354+0000', 'last_change': '2024-09-10T09:23:14.068354+0000', 'last_active': '2024-09-10T09:23:14.068354+0000', 'last_peered': '2024-09-10T09:23:14.068354+0000', 'last_clean': '2024-09-10T09:23:14.068354+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:14.068354+0000', 'last_undegraded': '2024-09-10T09:23:14.068354+0000', 'last_fullsized': '2024-09-10T09:23:14.068354+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:14.068354+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-10T09:23:18.806 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T09:23:13.065993+0000', 'last_change': '2024-09-10T09:23:13.065993+0000', 'last_active': '2024-09-10T09:23:13.065993+0000', 'last_peered': '2024-09-10T09:23:13.065993+0000', 'last_clean': '2024-09-10T09:23:13.065993+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T09:23:13.065993+0000', 'last_undegraded': '2024-09-10T09:23:13.065993+0000', 'last_fullsized': '2024-09-10T09:23:13.065993+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'last_clean_scrub_stamp': '2024-09-10T09:23:13.065993+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T09:23:18.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T09:23:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 Processor -- start 2024-09-10T09:23:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 -- start start 2024-09-10T09:23:18.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba40d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ba40cef90 0x7f6ba40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba40b7170 con 0x7f6ba415ed20 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba40d1ae0 con 0x7f6ba40cef90 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.927+0000 7f6ba9bc4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba40b7aa0 con 0x7f6ba415e940 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba2ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6ba415ed20 0x7f6ba40b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39064/0 (socket says 172.21.15.12:39064) 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba2ffd640 1 -- 172.21.15.12:0/2337651430 learned_addr learned my addr 172.21.15.12:0/2337651430 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:18.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba3fff640 1 --2- 172.21.15.12:0/2337651430 >> v2:172.21.15.100:3300/0 conn(0x7f6ba40cef90 0x7f6ba40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba37fe640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba40d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba27fc640 1 -- 172.21.15.12:0/2337651430 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377765441 0 0) 0x7f6b98001110 con 0x7f6ba415ed20 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba27fc640 1 -- 172.21.15.12:0/2337651430 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b8c003520 con 0x7f6ba415ed20 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba27fc640 1 -- 172.21.15.12:0/2337651430 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4107558894 0 0) 0x7f6b8c003520 con 0x7f6ba415ed20 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba3fff640 1 -- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 msgr2=0x7f6ba40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba3fff640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba40d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba3fff640 1 -- 172.21.15.12:0/2337651430 >> v1:172.21.15.12:6789/0 conn(0x7f6ba415ed20 legacy=0x7f6ba40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba3fff640 1 -- 172.21.15.12:0/2337651430 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba40d3660 con 0x7f6ba40cef90 2024-09-10T09:23:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.928+0000 7f6ba37fe640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba40d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.929+0000 7f6ba3fff640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba40d15a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009d90 tx=0x7f6b9c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec5ebaee4d0d9763 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.929+0000 7f6ba27fc640 1 -- 172.21.15.12:0/2337651430 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98001840 con 0x7f6ba40cef90 2024-09-10T09:23:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.929+0000 7f6ba27fc640 1 -- 172.21.15.12:0/2337651430 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b9c007540 con 0x7f6ba40cef90 2024-09-10T09:23:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.929+0000 7f6ba27fc640 1 -- 172.21.15.12:0/2337651430 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0078f0 con 0x7f6ba40cef90 2024-09-10T09:23:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 msgr2=0x7f6ba40d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba40d15a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009d90 tx=0x7f6b9c02a680 comp rx=0 tx=0).stop 2024-09-10T09:23:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/2337651430 shutdown_connections 2024-09-10T09:23:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba40d15a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/2337651430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba40d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/2337651430 >> 172.21.15.12:0/2337651430 conn(0x7f6ba40b6240 msgr2=0x7f6ba40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/2337651430 shutdown_connections 2024-09-10T09:23:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.930+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/2337651430 wait complete. 2024-09-10T09:23:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.931+0000 7f6ba9bc4640 1 Processor -- start 2024-09-10T09:23:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.931+0000 7f6ba9bc4640 1 -- start start 2024-09-10T09:23:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba9bc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba4145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba9bc4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba4145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba9bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 0x7f6ba4148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba9bc4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba40d3f00 con 0x7f6ba415ed20 2024-09-10T09:23:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba9bc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba40d3c20 con 0x7f6ba40cef90 2024-09-10T09:23:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba9bc4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba40d3310 con 0x7f6ba415e940 2024-09-10T09:23:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 0x7f6ba4148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 0x7f6ba4148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54958/0 (socket says 172.21.15.12:54958) 2024-09-10T09:23:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 -- 172.21.15.12:0/1145182737 learned_addr learned my addr 172.21.15.12:0/1145182737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba37fe640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba4145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba2ffd640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba4145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 -- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 msgr2=0x7f6ba4145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba4145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 -- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 msgr2=0x7f6ba4145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba4145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 -- 172.21.15.12:0/1145182737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba41e74c0 con 0x7f6ba415ed20 2024-09-10T09:23:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.932+0000 7f6ba3fff640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 0x7f6ba4148370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009eb0 tx=0x7f6b9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.933+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c009450 con 0x7f6ba415ed20 2024-09-10T09:23:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.933+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b9c004240 con 0x7f6ba415ed20 2024-09-10T09:23:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.933+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba41e77a0 con 0x7f6ba415ed20 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.933+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0045f0 con 0x7f6ba415ed20 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.933+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba415b930 con 0x7f6ba415ed20 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.934+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba40d1f80 con 0x7f6ba415ed20 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.934+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b9c03b410 con 0x7f6ba415ed20 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.935+0000 7f6b8bfff640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6b9006be30 0x7f6b9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.935+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6b9c0ac010 con 0x7f6ba415ed20 2024-09-10T09:23:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.935+0000 7f6ba37fe640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6b9006be30 0x7f6b9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:18.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.935+0000 7f6ba37fe640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6b9006be30 0x7f6b9006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009560 tx=0x7f6b94009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:18.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:18.939+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b9c03f030 con 0x7f6ba415ed20 2024-09-10T09:23:19.063 INFO:tasks.ceph.mds.d.smithi100.stderr:2024-09-10T09:23:19.062+0000 7f83ecafb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T09:23:19.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.183+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6ba40ba6b0 con 0x7f6ba415ed20 2024-09-10T09:23:19.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.183+0000 7f6b8bfff640 1 -- 172.21.15.12:0/1145182737 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3259 (secure 0 0 0) 0x7f6b9c07a360 con 0x7f6ba415ed20 2024-09-10T09:23:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:19.184 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":64,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1725960146,"num_in_osds":8,"osd_in_since":1725960137,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225132544,"bytes_avail":772868980736,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":14,"btime":"2024-09-10T09:23:17:104287+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4714}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-10T09:23:05.227956+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T09:23:19.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6b9006be30 msgr2=0x7f6b9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6b9006be30 0x7f6b9006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009560 tx=0x7f6b94009190 comp rx=0 tx=0).stop 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 msgr2=0x7f6ba4148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 0x7f6ba4148370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009eb0 tx=0x7f6b9c004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 shutdown_connections 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6b9006be30 0x7f6b9006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ba415ed20 0x7f6ba4148370 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ba415e940 0x7f6ba4145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 --2- 172.21.15.12:0/1145182737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba40cef90 0x7f6ba4145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 >> 172.21.15.12:0/1145182737 conn(0x7f6ba40b6240 msgr2=0x7f6ba40d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 shutdown_connections 2024-09-10T09:23:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.186+0000 7f6ba9bc4640 1 -- 172.21.15.12:0/1145182737 wait complete. 2024-09-10T09:23:19.197 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T09:23:19.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:19.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.299+0000 7f0d10ee4640 1 Processor -- start 2024-09-10T09:23:19.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.299+0000 7f0d10ee4640 1 -- start start 2024-09-10T09:23:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d10ee4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c06c1f0 0x7f0d0c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d10ee4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c0cd5f0 con 0x7f0d0c151c50 2024-09-10T09:23:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d10ee4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c0cd8d0 con 0x7f0d0c06be10 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d10ee4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cdbb0 con 0x7f0d0c06c1f0 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d09d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d0c151c50 0x7f0d0c162740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39068/0 (socket says 172.21.15.12:39068) 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d09d9b640 1 -- 172.21.15.12:0/1867496107 learned_addr learned my addr 172.21.15.12:0/1867496107 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c06c1f0 0x7f0d0c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814443960 0 0) 0x7f0d0c0cd5f0 con 0x7f0d0c151c50 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cf4003520 con 0x7f0d0c151c50 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.300+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452015570 0 0) 0x7f0d0c0cd8d0 con 0x7f0d0c06be10 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d0c0cd5f0 con 0x7f0d0c06be10 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4098436837 0 0) 0x7f0cf4003520 con 0x7f0d0c151c50 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c06c1f0 msgr2=0x7f0d0c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c06c1f0 0x7f0d0c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 >> v1:172.21.15.100:6789/0 conn(0x7f0d0c06be10 legacy=0x7f0d0c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0cde90 con 0x7f0d0c151c50 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f0d00001670 con 0x7f0d0c151c50 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 >> v1:172.21.15.12:6789/0 conn(0x7f0d0c151c50 legacy=0x7f0d0c162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cf4003b70 0x7f0cf4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0cf4004800 0x7f0cf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0cf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cdbb0 con 0x7f0cf40051c0 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf400d0c0 con 0x7f0cf4003b70 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf400d2c0 con 0x7f0cf4004800 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c06c1f0 0x7f0d0c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0a59c640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cf4003b70 0x7f0cf4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0cf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d09d9b640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0cf4004800 0x7f0cf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 -- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0cf4004800 msgr2=0x7f0cf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0cf4004800 0x7f0cf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 -- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cf4003b70 msgr2=0x7f0cf4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cf4003b70 0x7f0cf4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0ad9d640 1 -- 172.21.15.12:0/1867496107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf4003520 con 0x7f0cf40051c0 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.301+0000 7f0d0a59c640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cf4003b70 0x7f0cf4003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.302+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0cf400b9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e1f0 tx=0x7f0cf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e1038383d7f69d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.302+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04009d40 con 0x7f0cf40051c0 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.302+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d04035070 con 0x7f0cf40051c0 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.302+0000 7f0d0959a640 1 -- 172.21.15.12:0/1867496107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04004030 con 0x7f0cf40051c0 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d10ee4640 1 -- 172.21.15.12:0/1867496107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 msgr2=0x7f0cf400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/1867496107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0cf400b9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e1f0 tx=0x7f0cf4005830 comp rx=0 tx=0).stop 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d0ad9d640 1 -- 172.21.15.12:0/1867496107 reap_dead start 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d10ee4640 1 -- 172.21.15.12:0/1867496107 shutdown_connections 2024-09-10T09:23:19.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d10ee4640 1 -- 172.21.15.12:0/1867496107 >> 172.21.15.12:0/1867496107 conn(0x7f0d0c062cc0 msgr2=0x7f0d0c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d10ee4640 1 -- 172.21.15.12:0/1867496107 shutdown_connections 2024-09-10T09:23:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.303+0000 7f0d10ee4640 1 -- 172.21.15.12:0/1867496107 wait complete. 2024-09-10T09:23:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.304+0000 7f0d10ee4640 1 Processor -- start 2024-09-10T09:23:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.304+0000 7f0d10ee4640 1 -- start start 2024-09-10T09:23:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d10ee4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0d0c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d10ee4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c072310 0x7f0d0c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d10ee4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c073920 0x7f0d0c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d10ee4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cd010 con 0x7f0cf40051c0 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d10ee4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0ce690 con 0x7f0d0c072310 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d10ee4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cd190 con 0x7f0d0c073920 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0d0c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0d0c14fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54980/0 (socket says 172.21.15.12:54980) 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 -- 172.21.15.12:0/2889717242 learned_addr learned my addr 172.21.15.12:0/2889717242 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d09d9b640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c072310 0x7f0d0c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0ad9d640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c073920 0x7f0d0c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 -- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c073920 msgr2=0x7f0d0c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c073920 0x7f0d0c15dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 -- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c072310 msgr2=0x7f0d0c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c072310 0x7f0d0c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 -- 172.21.15.12:0/2889717242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c072880 con 0x7f0cf40051c0 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.305+0000 7f0d0a59c640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0d0c14fc70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00fb40 tx=0x7f0cfc00e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.306+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc015070 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.306+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc0050d0 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.306+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c072b60 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.306+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc0035f0 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.306+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c073120 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.307+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c15baa0 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.307+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0cfc018070 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.307+0000 7f0cfaffd640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0cec06be30 0x7f0cec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.308+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0cfc08b350 con 0x7f0cf40051c0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.308+0000 7f0d09d9b640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0cec06be30 0x7f0cec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.308+0000 7f0d09d9b640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0cec06be30 0x7f0cec06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c1f79d0 tx=0x7f0d00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:19.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.312+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cfc059d00 con 0x7f0cf40051c0 2024-09-10T09:23:19.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.487+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d0c0afd90 con 0x7f0cec06be30 2024-09-10T09:23:19.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.494+0000 7f0cfaffd640 1 -- 172.21.15.12:0/2889717242 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f0d0c0afd90 con 0x7f0cec06be30 2024-09-10T09:23:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:19.500 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:19.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0cec06be30 msgr2=0x7f0cec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0cec06be30 0x7f0cec06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c1f79d0 tx=0x7f0d00009040 comp rx=0 tx=0).stop 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 msgr2=0x7f0d0c14fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0d0c14fc70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00fb40 tx=0x7f0cfc00e2f0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 shutdown_connections 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0cec06be30 0x7f0cec06e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0d0c073920 0x7f0d0c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0c072310 0x7f0d0c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 --2- 172.21.15.12:0/2889717242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cf40051c0 0x7f0d0c14fc70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 >> 172.21.15.12:0/2889717242 conn(0x7f0d0c062cc0 msgr2=0x7f0d0c0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 shutdown_connections 2024-09-10T09:23:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:19.497+0000 7f0d10ee4640 1 -- 172.21.15.12:0/2889717242 wait complete. 2024-09-10T09:23:19.509 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-10T09:23:19.230623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220236,"kb_used_data":3984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754484,"statfs":{"total":773094113280,"available":772868591616,"internally_reserved":0,"allocated":4079616,"data_stored":2271204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001336"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071525+0000","last_change":"2024-09-10T09:23:15.109116+0000","last_active":"2024-09-10T09:23:17.071525+0000","last_peered":"2024-09-10T09:23:17.071525+0000","last_clean":"2024-09-10T09:23:17.071525+0000","last_became_active":"2024-09-10T09:23:15.108872+0000","last_became_peered":"2024-09-10T09:23:15.108872+0000","last_unstale":"2024-09-10T09:23:17.071525+0000","last_undegraded":"2024-09-10T09:23:17.071525+0000","last_fullsized":"2024-09-10T09:23:17.071525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:02.585818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527729+0000","last_change":"2024-09-10T09:23:15.100791+0000","last_active":"2024-09-10T09:23:16.527729+0000","last_peered":"2024-09-10T09:23:16.527729+0000","last_clean":"2024-09-10T09:23:16.527729+0000","last_became_active":"2024-09-10T09:23:15.100332+0000","last_became_peered":"2024-09-10T09:23:15.100332+0000","last_unstale":"2024-09-10T09:23:16.527729+0000","last_undegraded":"2024-09-10T09:23:16.527729+0000","last_fullsized":"2024-09-10T09:23:16.527729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:44:12.116099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107458+0000","last_change":"2024-09-10T09:23:15.113602+0000","last_active":"2024-09-10T09:23:16.107458+0000","last_peered":"2024-09-10T09:23:16.107458+0000","last_clean":"2024-09-10T09:23:16.107458+0000","last_became_active":"2024-09-10T09:23:15.113337+0000","last_became_peered":"2024-09-10T09:23:15.113337+0000","last_unstale":"2024-09-10T09:23:16.107458+0000","last_undegraded":"2024-09-10T09:23:16.107458+0000","last_fullsized":"2024-09-10T09:23:16.107458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:59.859840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116789+0000","last_change":"2024-09-10T09:23:15.114029+0000","last_active":"2024-09-10T09:23:16.116789+0000","last_peered":"2024-09-10T09:23:16.116789+0000","last_clean":"2024-09-10T09:23:16.116789+0000","last_became_active":"2024-09-10T09:23:15.113703+0000","last_became_peered":"2024-09-10T09:23:15.113703+0000","last_unstale":"2024-09-10T09:23:16.116789+0000","last_undegraded":"2024-09-10T09:23:16.116789+0000","last_fullsized":"2024-09-10T09:23:16.116789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:49.996219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.109441+0000","last_change":"2024-09-10T09:23:15.105129+0000","last_active":"2024-09-10T09:23:15.109441+0000","last_peered":"2024-09-10T09:23:15.109441+0000","last_clean":"2024-09-10T09:23:15.109441+0000","last_became_active":"2024-09-10T09:23:15.104837+0000","last_became_peered":"2024-09-10T09:23:15.104837+0000","last_unstale":"2024-09-10T09:23:15.109441+0000","last_undegraded":"2024-09-10T09:23:15.109441+0000","last_fullsized":"2024-09-10T09:23:15.109441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:17.738837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527376+0000","last_change":"2024-09-10T09:23:15.103633+0000","last_active":"2024-09-10T09:23:16.527376+0000","last_peered":"2024-09-10T09:23:16.527376+0000","last_clean":"2024-09-10T09:23:16.527376+0000","last_became_active":"2024-09-10T09:23:15.103338+0000","last_became_peered":"2024-09-10T09:23:15.103338+0000","last_unstale":"2024-09-10T09:23:16.527376+0000","last_undegraded":"2024-09-10T09:23:16.527376+0000","last_fullsized":"2024-09-10T09:23:16.527376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:57.019724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040535+0000","last_change":"2024-09-10T09:23:15.109608+0000","last_active":"2024-09-10T09:23:17.040535+0000","last_peered":"2024-09-10T09:23:17.040535+0000","last_clean":"2024-09-10T09:23:17.040535+0000","last_became_active":"2024-09-10T09:23:15.109275+0000","last_became_peered":"2024-09-10T09:23:15.109275+0000","last_unstale":"2024-09-10T09:23:17.040535+0000","last_undegraded":"2024-09-10T09:23:17.040535+0000","last_fullsized":"2024-09-10T09:23:17.040535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:51.430861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040279+0000","last_change":"2024-09-10T09:23:15.108441+0000","last_active":"2024-09-10T09:23:17.040279+0000","last_peered":"2024-09-10T09:23:17.040279+0000","last_clean":"2024-09-10T09:23:17.040279+0000","last_became_active":"2024-09-10T09:23:15.108168+0000","last_became_peered":"2024-09-10T09:23:15.108168+0000","last_unstale":"2024-09-10T09:23:17.040279+0000","last_undegraded":"2024-09-10T09:23:17.040279+0000","last_fullsized":"2024-09-10T09:23:17.040279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:09.673003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108672+0000","last_change":"2024-09-10T09:23:15.112735+0000","last_active":"2024-09-10T09:23:16.108672+0000","last_peered":"2024-09-10T09:23:16.108672+0000","last_clean":"2024-09-10T09:23:16.108672+0000","last_became_active":"2024-09-10T09:23:15.112477+0000","last_became_peered":"2024-09-10T09:23:15.112477+0000","last_unstale":"2024-09-10T09:23:16.108672+0000","last_undegraded":"2024-09-10T09:23:16.108672+0000","last_fullsized":"2024-09-10T09:23:16.108672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:54.342264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116895+0000","last_change":"2024-09-10T09:23:15.112042+0000","last_active":"2024-09-10T09:23:16.116895+0000","last_peered":"2024-09-10T09:23:16.116895+0000","last_clean":"2024-09-10T09:23:16.116895+0000","last_became_active":"2024-09-10T09:23:15.111711+0000","last_became_peered":"2024-09-10T09:23:15.111711+0000","last_unstale":"2024-09-10T09:23:16.116895+0000","last_undegraded":"2024-09-10T09:23:16.116895+0000","last_fullsized":"2024-09-10T09:23:16.116895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:16.998035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040608+0000","last_change":"2024-09-10T09:23:15.108849+0000","last_active":"2024-09-10T09:23:17.040608+0000","last_peered":"2024-09-10T09:23:17.040608+0000","last_clean":"2024-09-10T09:23:17.040608+0000","last_became_active":"2024-09-10T09:23:15.108600+0000","last_became_peered":"2024-09-10T09:23:15.108600+0000","last_unstale":"2024-09-10T09:23:17.040608+0000","last_undegraded":"2024-09-10T09:23:17.040608+0000","last_fullsized":"2024-09-10T09:23:17.040608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:36.212745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107380+0000","last_change":"2024-09-10T09:23:15.102459+0000","last_active":"2024-09-10T09:23:16.107380+0000","last_peered":"2024-09-10T09:23:16.107380+0000","last_clean":"2024-09-10T09:23:16.107380+0000","last_became_active":"2024-09-10T09:23:15.102203+0000","last_became_peered":"2024-09-10T09:23:15.102203+0000","last_unstale":"2024-09-10T09:23:16.107380+0000","last_undegraded":"2024-09-10T09:23:16.107380+0000","last_fullsized":"2024-09-10T09:23:16.107380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:47.787487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120823+0000","last_change":"2024-09-10T09:23:15.113990+0000","last_active":"2024-09-10T09:23:15.120823+0000","last_peered":"2024-09-10T09:23:15.120823+0000","last_clean":"2024-09-10T09:23:15.120823+0000","last_became_active":"2024-09-10T09:23:15.113678+0000","last_became_peered":"2024-09-10T09:23:15.113678+0000","last_unstale":"2024-09-10T09:23:15.120823+0000","last_undegraded":"2024-09-10T09:23:15.120823+0000","last_fullsized":"2024-09-10T09:23:15.120823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:28.443128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527607+0000","last_change":"2024-09-10T09:23:15.106201+0000","last_active":"2024-09-10T09:23:16.527607+0000","last_peered":"2024-09-10T09:23:16.527607+0000","last_clean":"2024-09-10T09:23:16.527607+0000","last_became_active":"2024-09-10T09:23:15.105537+0000","last_became_peered":"2024-09-10T09:23:15.105537+0000","last_unstale":"2024-09-10T09:23:16.527607+0000","last_undegraded":"2024-09-10T09:23:16.527607+0000","last_fullsized":"2024-09-10T09:23:16.527607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:58.628909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107256+0000","last_change":"2024-09-10T09:23:15.101655+0000","last_active":"2024-09-10T09:23:16.107256+0000","last_peered":"2024-09-10T09:23:16.107256+0000","last_clean":"2024-09-10T09:23:16.107256+0000","last_became_active":"2024-09-10T09:23:15.101399+0000","last_became_peered":"2024-09-10T09:23:15.101399+0000","last_unstale":"2024-09-10T09:23:16.107256+0000","last_undegraded":"2024-09-10T09:23:16.107256+0000","last_fullsized":"2024-09-10T09:23:16.107256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:51.430861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040677+0000","last_change":"2024-09-10T09:23:15.112870+0000","last_active":"2024-09-10T09:23:17.040677+0000","last_peered":"2024-09-10T09:23:17.040677+0000","last_clean":"2024-09-10T09:23:17.040677+0000","last_became_active":"2024-09-10T09:23:15.110570+0000","last_became_peered":"2024-09-10T09:23:15.110570+0000","last_unstale":"2024-09-10T09:23:17.040677+0000","last_undegraded":"2024-09-10T09:23:17.040677+0000","last_fullsized":"2024-09-10T09:23:17.040677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:59.859840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040691+0000","last_change":"2024-09-10T09:23:15.111793+0000","last_active":"2024-09-10T09:23:17.040691+0000","last_peered":"2024-09-10T09:23:17.040691+0000","last_clean":"2024-09-10T09:23:17.040691+0000","last_became_active":"2024-09-10T09:23:15.110636+0000","last_became_peered":"2024-09-10T09:23:15.110636+0000","last_unstale":"2024-09-10T09:23:17.040691+0000","last_undegraded":"2024-09-10T09:23:17.040691+0000","last_fullsized":"2024-09-10T09:23:17.040691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:35.730918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527856+0000","last_change":"2024-09-10T09:23:15.112593+0000","last_active":"2024-09-10T09:23:16.527856+0000","last_peered":"2024-09-10T09:23:16.527856+0000","last_clean":"2024-09-10T09:23:16.527856+0000","last_became_active":"2024-09-10T09:23:15.112323+0000","last_became_peered":"2024-09-10T09:23:15.112323+0000","last_unstale":"2024-09-10T09:23:16.527856+0000","last_undegraded":"2024-09-10T09:23:16.527856+0000","last_fullsized":"2024-09-10T09:23:16.527856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:50.246172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527659+0000","last_change":"2024-09-10T09:23:15.112647+0000","last_active":"2024-09-10T09:23:16.527659+0000","last_peered":"2024-09-10T09:23:16.527659+0000","last_clean":"2024-09-10T09:23:16.527659+0000","last_became_active":"2024-09-10T09:23:15.112347+0000","last_became_peered":"2024-09-10T09:23:15.112347+0000","last_unstale":"2024-09-10T09:23:16.527659+0000","last_undegraded":"2024-09-10T09:23:16.527659+0000","last_fullsized":"2024-09-10T09:23:16.527659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:08.835262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120815+0000","last_change":"2024-09-10T09:23:15.113396+0000","last_active":"2024-09-10T09:23:15.120815+0000","last_peered":"2024-09-10T09:23:15.120815+0000","last_clean":"2024-09-10T09:23:15.120815+0000","last_became_active":"2024-09-10T09:23:15.113135+0000","last_became_peered":"2024-09-10T09:23:15.113135+0000","last_unstale":"2024-09-10T09:23:15.120815+0000","last_undegraded":"2024-09-10T09:23:15.120815+0000","last_fullsized":"2024-09-10T09:23:15.120815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:19.929957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108174+0000","last_change":"2024-09-10T09:23:15.107171+0000","last_active":"2024-09-10T09:23:16.108174+0000","last_peered":"2024-09-10T09:23:16.108174+0000","last_clean":"2024-09-10T09:23:16.108174+0000","last_became_active":"2024-09-10T09:23:15.106891+0000","last_became_peered":"2024-09-10T09:23:15.106891+0000","last_unstale":"2024-09-10T09:23:16.108174+0000","last_undegraded":"2024-09-10T09:23:16.108174+0000","last_fullsized":"2024-09-10T09:23:16.108174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:33.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108636+0000","last_change":"2024-09-10T09:23:15.103781+0000","last_active":"2024-09-10T09:23:16.108636+0000","last_peered":"2024-09-10T09:23:16.108636+0000","last_clean":"2024-09-10T09:23:16.108636+0000","last_became_active":"2024-09-10T09:23:15.103412+0000","last_became_peered":"2024-09-10T09:23:15.103412+0000","last_unstale":"2024-09-10T09:23:16.108636+0000","last_undegraded":"2024-09-10T09:23:16.108636+0000","last_fullsized":"2024-09-10T09:23:16.108636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:44.497740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.105979+0000","last_change":"2024-09-10T09:23:15.105473+0000","last_active":"2024-09-10T09:23:16.105979+0000","last_peered":"2024-09-10T09:23:16.105979+0000","last_clean":"2024-09-10T09:23:16.105979+0000","last_became_active":"2024-09-10T09:23:15.105179+0000","last_became_peered":"2024-09-10T09:23:15.105179+0000","last_unstale":"2024-09-10T09:23:16.105979+0000","last_undegraded":"2024-09-10T09:23:16.105979+0000","last_fullsized":"2024-09-10T09:23:16.105979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:35.766176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107033+0000","last_change":"2024-09-10T09:23:15.105839+0000","last_active":"2024-09-10T09:23:16.107033+0000","last_peered":"2024-09-10T09:23:16.107033+0000","last_clean":"2024-09-10T09:23:16.107033+0000","last_became_active":"2024-09-10T09:23:15.105375+0000","last_became_peered":"2024-09-10T09:23:15.105375+0000","last_unstale":"2024-09-10T09:23:16.107033+0000","last_undegraded":"2024-09-10T09:23:16.107033+0000","last_fullsized":"2024-09-10T09:23:16.107033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:57.258464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117003+0000","last_change":"2024-09-10T09:23:15.110193+0000","last_active":"2024-09-10T09:23:16.117003+0000","last_peered":"2024-09-10T09:23:16.117003+0000","last_clean":"2024-09-10T09:23:16.117003+0000","last_became_active":"2024-09-10T09:23:15.108944+0000","last_became_peered":"2024-09-10T09:23:15.108944+0000","last_unstale":"2024-09-10T09:23:16.117003+0000","last_undegraded":"2024-09-10T09:23:16.117003+0000","last_fullsized":"2024-09-10T09:23:16.117003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:41.257440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527891+0000","last_change":"2024-09-10T09:23:15.110687+0000","last_active":"2024-09-10T09:23:16.527891+0000","last_peered":"2024-09-10T09:23:16.527891+0000","last_clean":"2024-09-10T09:23:16.527891+0000","last_became_active":"2024-09-10T09:23:15.110418+0000","last_became_peered":"2024-09-10T09:23:15.110418+0000","last_unstale":"2024-09-10T09:23:16.527891+0000","last_undegraded":"2024-09-10T09:23:16.527891+0000","last_fullsized":"2024-09-10T09:23:16.527891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:50.548033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117123+0000","last_change":"2024-09-10T09:23:15.112856+0000","last_active":"2024-09-10T09:23:16.117123+0000","last_peered":"2024-09-10T09:23:16.117123+0000","last_clean":"2024-09-10T09:23:16.117123+0000","last_became_active":"2024-09-10T09:23:15.112579+0000","last_became_peered":"2024-09-10T09:23:15.112579+0000","last_unstale":"2024-09-10T09:23:16.117123+0000","last_undegraded":"2024-09-10T09:23:16.117123+0000","last_fullsized":"2024-09-10T09:23:16.117123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.096970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107403+0000","last_change":"2024-09-10T09:23:15.101677+0000","last_active":"2024-09-10T09:23:16.107403+0000","last_peered":"2024-09-10T09:23:16.107403+0000","last_clean":"2024-09-10T09:23:16.107403+0000","last_became_active":"2024-09-10T09:23:15.101414+0000","last_became_peered":"2024-09-10T09:23:15.101414+0000","last_unstale":"2024-09-10T09:23:16.107403+0000","last_undegraded":"2024-09-10T09:23:16.107403+0000","last_fullsized":"2024-09-10T09:23:16.107403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:36.212745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108379+0000","last_change":"2024-09-10T09:23:15.110939+0000","last_active":"2024-09-10T09:23:16.108379+0000","last_peered":"2024-09-10T09:23:16.108379+0000","last_clean":"2024-09-10T09:23:16.108379+0000","last_became_active":"2024-09-10T09:23:15.110562+0000","last_became_peered":"2024-09-10T09:23:15.110562+0000","last_unstale":"2024-09-10T09:23:16.108379+0000","last_undegraded":"2024-09-10T09:23:16.108379+0000","last_fullsized":"2024-09-10T09:23:16.108379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:24.794929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040263+0000","last_change":"2024-09-10T09:23:15.112314+0000","last_active":"2024-09-10T09:23:17.040263+0000","last_peered":"2024-09-10T09:23:17.040263+0000","last_clean":"2024-09-10T09:23:17.040263+0000","last_became_active":"2024-09-10T09:23:15.110509+0000","last_became_peered":"2024-09-10T09:23:15.110509+0000","last_unstale":"2024-09-10T09:23:17.040263+0000","last_undegraded":"2024-09-10T09:23:17.040263+0000","last_fullsized":"2024-09-10T09:23:17.040263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:31.611745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071350+0000","last_change":"2024-09-10T09:23:15.108792+0000","last_active":"2024-09-10T09:23:17.071350+0000","last_peered":"2024-09-10T09:23:17.071350+0000","last_clean":"2024-09-10T09:23:17.071350+0000","last_became_active":"2024-09-10T09:23:15.108503+0000","last_became_peered":"2024-09-10T09:23:15.108503+0000","last_unstale":"2024-09-10T09:23:17.071350+0000","last_undegraded":"2024-09-10T09:23:17.071350+0000","last_fullsized":"2024-09-10T09:23:17.071350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:24.917910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040323+0000","last_change":"2024-09-10T09:23:15.114025+0000","last_active":"2024-09-10T09:23:17.040323+0000","last_peered":"2024-09-10T09:23:17.040323+0000","last_clean":"2024-09-10T09:23:17.040323+0000","last_became_active":"2024-09-10T09:23:15.113786+0000","last_became_peered":"2024-09-10T09:23:15.113786+0000","last_unstale":"2024-09-10T09:23:17.040323+0000","last_undegraded":"2024-09-10T09:23:17.040323+0000","last_fullsized":"2024-09-10T09:23:17.040323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:45.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106123+0000","last_change":"2024-09-10T09:23:15.108603+0000","last_active":"2024-09-10T09:23:16.106123+0000","last_peered":"2024-09-10T09:23:16.106123+0000","last_clean":"2024-09-10T09:23:16.106123+0000","last_became_active":"2024-09-10T09:23:15.108228+0000","last_became_peered":"2024-09-10T09:23:15.108228+0000","last_unstale":"2024-09-10T09:23:16.106123+0000","last_undegraded":"2024-09-10T09:23:16.106123+0000","last_fullsized":"2024-09-10T09:23:16.106123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:56.264172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071595+0000","last_change":"2024-09-10T09:23:14.091840+0000","last_active":"2024-09-10T09:23:17.071595+0000","last_peered":"2024-09-10T09:23:17.071595+0000","last_clean":"2024-09-10T09:23:17.071595+0000","last_became_active":"2024-09-10T09:23:14.091522+0000","last_became_peered":"2024-09-10T09:23:14.091522+0000","last_unstale":"2024-09-10T09:23:17.071595+0000","last_undegraded":"2024-09-10T09:23:17.071595+0000","last_fullsized":"2024-09-10T09:23:17.071595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:22.619886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071535+0000","last_change":"2024-09-10T09:23:15.111579+0000","last_active":"2024-09-10T09:23:17.071535+0000","last_peered":"2024-09-10T09:23:17.071535+0000","last_clean":"2024-09-10T09:23:17.071535+0000","last_became_active":"2024-09-10T09:23:15.111305+0000","last_became_peered":"2024-09-10T09:23:15.111305+0000","last_unstale":"2024-09-10T09:23:17.071535+0000","last_undegraded":"2024-09-10T09:23:17.071535+0000","last_fullsized":"2024-09-10T09:23:17.071535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:56.264172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106129+0000","last_change":"2024-09-10T09:23:14.087708+0000","last_active":"2024-09-10T09:23:16.106129+0000","last_peered":"2024-09-10T09:23:16.106129+0000","last_clean":"2024-09-10T09:23:16.106129+0000","last_became_active":"2024-09-10T09:23:14.087333+0000","last_became_peered":"2024-09-10T09:23:14.087333+0000","last_unstale":"2024-09-10T09:23:16.106129+0000","last_undegraded":"2024-09-10T09:23:16.106129+0000","last_fullsized":"2024-09-10T09:23:16.106129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:09.909052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108510+0000","last_change":"2024-09-10T09:23:15.110923+0000","last_active":"2024-09-10T09:23:16.108510+0000","last_peered":"2024-09-10T09:23:16.108510+0000","last_clean":"2024-09-10T09:23:16.108510+0000","last_became_active":"2024-09-10T09:23:15.107021+0000","last_became_peered":"2024-09-10T09:23:15.107021+0000","last_unstale":"2024-09-10T09:23:16.108510+0000","last_undegraded":"2024-09-10T09:23:16.108510+0000","last_fullsized":"2024-09-10T09:23:16.108510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:03.906458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527509+0000","last_change":"2024-09-10T09:23:14.092345+0000","last_active":"2024-09-10T09:23:16.527509+0000","last_peered":"2024-09-10T09:23:16.527509+0000","last_clean":"2024-09-10T09:23:16.527509+0000","last_became_active":"2024-09-10T09:23:14.092049+0000","last_became_peered":"2024-09-10T09:23:14.092049+0000","last_unstale":"2024-09-10T09:23:16.527509+0000","last_undegraded":"2024-09-10T09:23:16.527509+0000","last_fullsized":"2024-09-10T09:23:16.527509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.792568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117182+0000","last_change":"2024-09-10T09:23:15.112860+0000","last_active":"2024-09-10T09:23:16.117182+0000","last_peered":"2024-09-10T09:23:16.117182+0000","last_clean":"2024-09-10T09:23:16.117182+0000","last_became_active":"2024-09-10T09:23:15.112603+0000","last_became_peered":"2024-09-10T09:23:15.112603+0000","last_unstale":"2024-09-10T09:23:16.117182+0000","last_undegraded":"2024-09-10T09:23:16.117182+0000","last_fullsized":"2024-09-10T09:23:16.117182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:00:01.440502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.123775+0000","last_change":"2024-09-10T09:23:14.093063+0000","last_active":"2024-09-10T09:23:15.123775+0000","last_peered":"2024-09-10T09:23:15.123775+0000","last_clean":"2024-09-10T09:23:15.123775+0000","last_became_active":"2024-09-10T09:23:14.092800+0000","last_became_peered":"2024-09-10T09:23:14.092800+0000","last_unstale":"2024-09-10T09:23:15.123775+0000","last_undegraded":"2024-09-10T09:23:15.123775+0000","last_fullsized":"2024-09-10T09:23:15.123775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:27.795911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040338+0000","last_change":"2024-09-10T09:23:15.113946+0000","last_active":"2024-09-10T09:23:17.040338+0000","last_peered":"2024-09-10T09:23:17.040338+0000","last_clean":"2024-09-10T09:23:17.040338+0000","last_became_active":"2024-09-10T09:23:15.113707+0000","last_became_peered":"2024-09-10T09:23:15.113707+0000","last_unstale":"2024-09-10T09:23:17.040338+0000","last_undegraded":"2024-09-10T09:23:17.040338+0000","last_fullsized":"2024-09-10T09:23:17.040338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:14.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108324+0000","last_change":"2024-09-10T09:23:14.090716+0000","last_active":"2024-09-10T09:23:16.108324+0000","last_peered":"2024-09-10T09:23:16.108324+0000","last_clean":"2024-09-10T09:23:16.108324+0000","last_became_active":"2024-09-10T09:23:14.090120+0000","last_became_peered":"2024-09-10T09:23:14.090120+0000","last_unstale":"2024-09-10T09:23:16.108324+0000","last_undegraded":"2024-09-10T09:23:16.108324+0000","last_fullsized":"2024-09-10T09:23:16.108324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:46.451689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107199+0000","last_change":"2024-09-10T09:23:15.105153+0000","last_active":"2024-09-10T09:23:16.107199+0000","last_peered":"2024-09-10T09:23:16.107199+0000","last_clean":"2024-09-10T09:23:16.107199+0000","last_became_active":"2024-09-10T09:23:15.104896+0000","last_became_peered":"2024-09-10T09:23:15.104896+0000","last_unstale":"2024-09-10T09:23:16.107199+0000","last_undegraded":"2024-09-10T09:23:16.107199+0000","last_fullsized":"2024-09-10T09:23:16.107199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:45.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108748+0000","last_change":"2024-09-10T09:23:14.090542+0000","last_active":"2024-09-10T09:23:16.108748+0000","last_peered":"2024-09-10T09:23:16.108748+0000","last_clean":"2024-09-10T09:23:16.108748+0000","last_became_active":"2024-09-10T09:23:14.090273+0000","last_became_peered":"2024-09-10T09:23:14.090273+0000","last_unstale":"2024-09-10T09:23:16.108748+0000","last_undegraded":"2024-09-10T09:23:16.108748+0000","last_fullsized":"2024-09-10T09:23:16.108748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.368076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108136+0000","last_change":"2024-09-10T09:23:15.110471+0000","last_active":"2024-09-10T09:23:16.108136+0000","last_peered":"2024-09-10T09:23:16.108136+0000","last_clean":"2024-09-10T09:23:16.108136+0000","last_became_active":"2024-09-10T09:23:15.110148+0000","last_became_peered":"2024-09-10T09:23:15.110148+0000","last_unstale":"2024-09-10T09:23:16.108136+0000","last_undegraded":"2024-09-10T09:23:16.108136+0000","last_fullsized":"2024-09-10T09:23:16.108136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:52.417628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527388+0000","last_change":"2024-09-10T09:23:14.094441+0000","last_active":"2024-09-10T09:23:16.527388+0000","last_peered":"2024-09-10T09:23:16.527388+0000","last_clean":"2024-09-10T09:23:16.527388+0000","last_became_active":"2024-09-10T09:23:14.094161+0000","last_became_peered":"2024-09-10T09:23:14.094161+0000","last_unstale":"2024-09-10T09:23:16.527388+0000","last_undegraded":"2024-09-10T09:23:16.527388+0000","last_fullsized":"2024-09-10T09:23:16.527388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:31.353371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116576+0000","last_change":"2024-09-10T09:23:15.102590+0000","last_active":"2024-09-10T09:23:16.116576+0000","last_peered":"2024-09-10T09:23:16.116576+0000","last_clean":"2024-09-10T09:23:16.116576+0000","last_became_active":"2024-09-10T09:23:15.102322+0000","last_became_peered":"2024-09-10T09:23:15.102322+0000","last_unstale":"2024-09-10T09:23:16.116576+0000","last_undegraded":"2024-09-10T09:23:16.116576+0000","last_fullsized":"2024-09-10T09:23:16.116576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:54.342264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108023+0000","last_change":"2024-09-10T09:23:14.088326+0000","last_active":"2024-09-10T09:23:16.108023+0000","last_peered":"2024-09-10T09:23:16.108023+0000","last_clean":"2024-09-10T09:23:16.108023+0000","last_became_active":"2024-09-10T09:23:14.088041+0000","last_became_peered":"2024-09-10T09:23:14.088041+0000","last_unstale":"2024-09-10T09:23:16.108023+0000","last_undegraded":"2024-09-10T09:23:16.108023+0000","last_fullsized":"2024-09-10T09:23:16.108023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:57.508460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107380+0000","last_change":"2024-09-10T09:23:15.102541+0000","last_active":"2024-09-10T09:23:16.107380+0000","last_peered":"2024-09-10T09:23:16.107380+0000","last_clean":"2024-09-10T09:23:16.107380+0000","last_became_active":"2024-09-10T09:23:15.102278+0000","last_became_peered":"2024-09-10T09:23:15.102278+0000","last_unstale":"2024-09-10T09:23:16.107380+0000","last_undegraded":"2024-09-10T09:23:16.107380+0000","last_fullsized":"2024-09-10T09:23:16.107380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:01.134511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527786+0000","last_change":"2024-09-10T09:23:14.088188+0000","last_active":"2024-09-10T09:23:16.527786+0000","last_peered":"2024-09-10T09:23:16.527786+0000","last_clean":"2024-09-10T09:23:16.527786+0000","last_became_active":"2024-09-10T09:23:14.087874+0000","last_became_peered":"2024-09-10T09:23:14.087874+0000","last_unstale":"2024-09-10T09:23:16.527786+0000","last_undegraded":"2024-09-10T09:23:16.527786+0000","last_fullsized":"2024-09-10T09:23:16.527786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:32.625742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527737+0000","last_change":"2024-09-10T09:23:15.112119+0000","last_active":"2024-09-10T09:23:16.527737+0000","last_peered":"2024-09-10T09:23:16.527737+0000","last_clean":"2024-09-10T09:23:16.527737+0000","last_became_active":"2024-09-10T09:23:15.111784+0000","last_became_peered":"2024-09-10T09:23:15.111784+0000","last_unstale":"2024-09-10T09:23:16.527737+0000","last_undegraded":"2024-09-10T09:23:16.527737+0000","last_fullsized":"2024-09-10T09:23:16.527737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:17.642071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106223+0000","last_change":"2024-09-10T09:23:14.093608+0000","last_active":"2024-09-10T09:23:16.106223+0000","last_peered":"2024-09-10T09:23:16.106223+0000","last_clean":"2024-09-10T09:23:16.106223+0000","last_became_active":"2024-09-10T09:23:14.092903+0000","last_became_peered":"2024-09-10T09:23:14.092903+0000","last_unstale":"2024-09-10T09:23:16.106223+0000","last_undegraded":"2024-09-10T09:23:16.106223+0000","last_fullsized":"2024-09-10T09:23:16.106223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:31.617271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527627+0000","last_change":"2024-09-10T09:23:15.104971+0000","last_active":"2024-09-10T09:23:16.527627+0000","last_peered":"2024-09-10T09:23:16.527627+0000","last_clean":"2024-09-10T09:23:16.527627+0000","last_became_active":"2024-09-10T09:23:15.104617+0000","last_became_peered":"2024-09-10T09:23:15.104617+0000","last_unstale":"2024-09-10T09:23:16.527627+0000","last_undegraded":"2024-09-10T09:23:16.527627+0000","last_fullsized":"2024-09-10T09:23:16.527627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:39.615093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107466+0000","last_change":"2024-09-10T09:23:14.087172+0000","last_active":"2024-09-10T09:23:16.107466+0000","last_peered":"2024-09-10T09:23:16.107466+0000","last_clean":"2024-09-10T09:23:16.107466+0000","last_became_active":"2024-09-10T09:23:14.086892+0000","last_became_peered":"2024-09-10T09:23:14.086892+0000","last_unstale":"2024-09-10T09:23:16.107466+0000","last_undegraded":"2024-09-10T09:23:16.107466+0000","last_fullsized":"2024-09-10T09:23:16.107466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:06.830381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107242+0000","last_change":"2024-09-10T09:23:15.113651+0000","last_active":"2024-09-10T09:23:16.107242+0000","last_peered":"2024-09-10T09:23:16.107242+0000","last_clean":"2024-09-10T09:23:16.107242+0000","last_became_active":"2024-09-10T09:23:15.113397+0000","last_became_peered":"2024-09-10T09:23:15.113397+0000","last_unstale":"2024-09-10T09:23:16.107242+0000","last_undegraded":"2024-09-10T09:23:16.107242+0000","last_fullsized":"2024-09-10T09:23:16.107242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:14.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527686+0000","last_change":"2024-09-10T09:23:14.093220+0000","last_active":"2024-09-10T09:23:16.527686+0000","last_peered":"2024-09-10T09:23:16.527686+0000","last_clean":"2024-09-10T09:23:16.527686+0000","last_became_active":"2024-09-10T09:23:14.092931+0000","last_became_peered":"2024-09-10T09:23:14.092931+0000","last_unstale":"2024-09-10T09:23:16.527686+0000","last_undegraded":"2024-09-10T09:23:16.527686+0000","last_fullsized":"2024-09-10T09:23:16.527686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:51.789313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116586+0000","last_change":"2024-09-10T09:23:15.108984+0000","last_active":"2024-09-10T09:23:16.116586+0000","last_peered":"2024-09-10T09:23:16.116586+0000","last_clean":"2024-09-10T09:23:16.116586+0000","last_became_active":"2024-09-10T09:23:15.108688+0000","last_became_peered":"2024-09-10T09:23:15.108688+0000","last_unstale":"2024-09-10T09:23:16.116586+0000","last_undegraded":"2024-09-10T09:23:16.116586+0000","last_fullsized":"2024-09-10T09:23:16.116586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:38:29.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108492+0000","last_change":"2024-09-10T09:23:14.087763+0000","last_active":"2024-09-10T09:23:16.108492+0000","last_peered":"2024-09-10T09:23:16.108492+0000","last_clean":"2024-09-10T09:23:16.108492+0000","last_became_active":"2024-09-10T09:23:14.087499+0000","last_became_peered":"2024-09-10T09:23:14.087499+0000","last_unstale":"2024-09-10T09:23:16.108492+0000","last_undegraded":"2024-09-10T09:23:16.108492+0000","last_fullsized":"2024-09-10T09:23:16.108492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:23.272366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527641+0000","last_change":"2024-09-10T09:23:15.101478+0000","last_active":"2024-09-10T09:23:16.527641+0000","last_peered":"2024-09-10T09:23:16.527641+0000","last_clean":"2024-09-10T09:23:16.527641+0000","last_became_active":"2024-09-10T09:23:15.101193+0000","last_became_peered":"2024-09-10T09:23:15.101193+0000","last_unstale":"2024-09-10T09:23:16.527641+0000","last_undegraded":"2024-09-10T09:23:16.527641+0000","last_fullsized":"2024-09-10T09:23:16.527641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:30.405421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116607+0000","last_change":"2024-09-10T09:23:14.086819+0000","last_active":"2024-09-10T09:23:16.116607+0000","last_peered":"2024-09-10T09:23:16.116607+0000","last_clean":"2024-09-10T09:23:16.116607+0000","last_became_active":"2024-09-10T09:23:14.086492+0000","last_became_peered":"2024-09-10T09:23:14.086492+0000","last_unstale":"2024-09-10T09:23:16.116607+0000","last_undegraded":"2024-09-10T09:23:16.116607+0000","last_fullsized":"2024-09-10T09:23:16.116607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:55.544022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040523+0000","last_change":"2024-09-10T09:23:15.114637+0000","last_active":"2024-09-10T09:23:17.040523+0000","last_peered":"2024-09-10T09:23:17.040523+0000","last_clean":"2024-09-10T09:23:17.040523+0000","last_became_active":"2024-09-10T09:23:15.114335+0000","last_became_peered":"2024-09-10T09:23:15.114335+0000","last_unstale":"2024-09-10T09:23:17.040523+0000","last_undegraded":"2024-09-10T09:23:17.040523+0000","last_fullsized":"2024-09-10T09:23:17.040523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:47.787487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527309+0000","last_change":"2024-09-10T09:23:14.086789+0000","last_active":"2024-09-10T09:23:16.527309+0000","last_peered":"2024-09-10T09:23:16.527309+0000","last_clean":"2024-09-10T09:23:16.527309+0000","last_became_active":"2024-09-10T09:23:14.086491+0000","last_became_peered":"2024-09-10T09:23:14.086491+0000","last_unstale":"2024-09-10T09:23:16.527309+0000","last_undegraded":"2024-09-10T09:23:16.527309+0000","last_fullsized":"2024-09-10T09:23:16.527309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:27.131435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071439+0000","last_change":"2024-09-10T09:23:15.112018+0000","last_active":"2024-09-10T09:23:17.071439+0000","last_peered":"2024-09-10T09:23:17.071439+0000","last_clean":"2024-09-10T09:23:17.071439+0000","last_became_active":"2024-09-10T09:23:15.111767+0000","last_became_peered":"2024-09-10T09:23:15.111767+0000","last_unstale":"2024-09-10T09:23:17.071439+0000","last_undegraded":"2024-09-10T09:23:17.071439+0000","last_fullsized":"2024-09-10T09:23:17.071439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:35.766176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527557+0000","last_change":"2024-09-10T09:23:14.095637+0000","last_active":"2024-09-10T09:23:16.527557+0000","last_peered":"2024-09-10T09:23:16.527557+0000","last_clean":"2024-09-10T09:23:16.527557+0000","last_became_active":"2024-09-10T09:23:14.095310+0000","last_became_peered":"2024-09-10T09:23:14.095310+0000","last_unstale":"2024-09-10T09:23:16.527557+0000","last_undegraded":"2024-09-10T09:23:16.527557+0000","last_fullsized":"2024-09-10T09:23:16.527557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:51.415267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108449+0000","last_change":"2024-09-10T09:23:15.111375+0000","last_active":"2024-09-10T09:23:16.108449+0000","last_peered":"2024-09-10T09:23:16.108449+0000","last_clean":"2024-09-10T09:23:16.108449+0000","last_became_active":"2024-09-10T09:23:15.107896+0000","last_became_peered":"2024-09-10T09:23:15.107896+0000","last_unstale":"2024-09-10T09:23:16.108449+0000","last_undegraded":"2024-09-10T09:23:16.108449+0000","last_fullsized":"2024-09-10T09:23:16.108449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:52.791674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117062+0000","last_change":"2024-09-10T09:23:14.097464+0000","last_active":"2024-09-10T09:23:16.117062+0000","last_peered":"2024-09-10T09:23:16.117062+0000","last_clean":"2024-09-10T09:23:16.117062+0000","last_became_active":"2024-09-10T09:23:14.097145+0000","last_became_peered":"2024-09-10T09:23:14.097145+0000","last_unstale":"2024-09-10T09:23:16.117062+0000","last_undegraded":"2024-09-10T09:23:16.117062+0000","last_fullsized":"2024-09-10T09:23:16.117062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:51.497947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107649+0000","last_change":"2024-09-10T09:23:15.107831+0000","last_active":"2024-09-10T09:23:16.107649+0000","last_peered":"2024-09-10T09:23:16.107649+0000","last_clean":"2024-09-10T09:23:16.107649+0000","last_became_active":"2024-09-10T09:23:15.107580+0000","last_became_peered":"2024-09-10T09:23:15.107580+0000","last_unstale":"2024-09-10T09:23:16.107649+0000","last_undegraded":"2024-09-10T09:23:16.107649+0000","last_fullsized":"2024-09-10T09:23:16.107649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:35.730918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108515+0000","last_change":"2024-09-10T09:23:14.088057+0000","last_active":"2024-09-10T09:23:16.108515+0000","last_peered":"2024-09-10T09:23:16.108515+0000","last_clean":"2024-09-10T09:23:16.108515+0000","last_became_active":"2024-09-10T09:23:14.087506+0000","last_became_peered":"2024-09-10T09:23:14.087506+0000","last_unstale":"2024-09-10T09:23:16.108515+0000","last_undegraded":"2024-09-10T09:23:16.108515+0000","last_fullsized":"2024-09-10T09:23:16.108515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:08.645216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116831+0000","last_change":"2024-09-10T09:23:15.114857+0000","last_active":"2024-09-10T09:23:16.116831+0000","last_peered":"2024-09-10T09:23:16.116831+0000","last_clean":"2024-09-10T09:23:16.116831+0000","last_became_active":"2024-09-10T09:23:15.113307+0000","last_became_peered":"2024-09-10T09:23:15.113307+0000","last_unstale":"2024-09-10T09:23:16.116831+0000","last_undegraded":"2024-09-10T09:23:16.116831+0000","last_fullsized":"2024-09-10T09:23:16.116831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.794887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108465+0000","last_change":"2024-09-10T09:23:14.079258+0000","last_active":"2024-09-10T09:23:16.108465+0000","last_peered":"2024-09-10T09:23:16.108465+0000","last_clean":"2024-09-10T09:23:16.108465+0000","last_became_active":"2024-09-10T09:23:14.078798+0000","last_became_peered":"2024-09-10T09:23:14.078798+0000","last_unstale":"2024-09-10T09:23:16.108465+0000","last_undegraded":"2024-09-10T09:23:16.108465+0000","last_fullsized":"2024-09-10T09:23:16.108465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:28.039387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120489+0000","last_change":"2024-09-10T09:23:15.110219+0000","last_active":"2024-09-10T09:23:15.120489+0000","last_peered":"2024-09-10T09:23:15.120489+0000","last_clean":"2024-09-10T09:23:15.120489+0000","last_became_active":"2024-09-10T09:23:15.109885+0000","last_became_peered":"2024-09-10T09:23:15.109885+0000","last_unstale":"2024-09-10T09:23:15.120489+0000","last_undegraded":"2024-09-10T09:23:15.120489+0000","last_fullsized":"2024-09-10T09:23:15.120489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:49.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108620+0000","last_change":"2024-09-10T09:23:14.087164+0000","last_active":"2024-09-10T09:23:16.108620+0000","last_peered":"2024-09-10T09:23:16.108620+0000","last_clean":"2024-09-10T09:23:16.108620+0000","last_became_active":"2024-09-10T09:23:14.086912+0000","last_became_peered":"2024-09-10T09:23:14.086912+0000","last_unstale":"2024-09-10T09:23:16.108620+0000","last_undegraded":"2024-09-10T09:23:16.108620+0000","last_fullsized":"2024-09-10T09:23:16.108620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:37.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120805+0000","last_change":"2024-09-10T09:23:15.113221+0000","last_active":"2024-09-10T09:23:15.120805+0000","last_peered":"2024-09-10T09:23:15.120805+0000","last_clean":"2024-09-10T09:23:15.120805+0000","last_became_active":"2024-09-10T09:23:15.112926+0000","last_became_peered":"2024-09-10T09:23:15.112926+0000","last_unstale":"2024-09-10T09:23:15.120805+0000","last_undegraded":"2024-09-10T09:23:15.120805+0000","last_fullsized":"2024-09-10T09:23:15.120805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:44.304719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106202+0000","last_change":"2024-09-10T09:23:14.094864+0000","last_active":"2024-09-10T09:23:16.106202+0000","last_peered":"2024-09-10T09:23:16.106202+0000","last_clean":"2024-09-10T09:23:16.106202+0000","last_became_active":"2024-09-10T09:23:14.094568+0000","last_became_peered":"2024-09-10T09:23:14.094568+0000","last_unstale":"2024-09-10T09:23:16.106202+0000","last_undegraded":"2024-09-10T09:23:16.106202+0000","last_fullsized":"2024-09-10T09:23:16.106202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:22.619886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.109418+0000","last_change":"2024-09-10T09:23:15.104419+0000","last_active":"2024-09-10T09:23:15.109418+0000","last_peered":"2024-09-10T09:23:15.109418+0000","last_clean":"2024-09-10T09:23:15.109418+0000","last_became_active":"2024-09-10T09:23:15.104118+0000","last_became_peered":"2024-09-10T09:23:15.104118+0000","last_unstale":"2024-09-10T09:23:15.109418+0000","last_undegraded":"2024-09-10T09:23:15.109418+0000","last_fullsized":"2024-09-10T09:23:15.109418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:45.414616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071280+0000","last_change":"2024-09-10T09:23:14.093049+0000","last_active":"2024-09-10T09:23:17.071280+0000","last_peered":"2024-09-10T09:23:17.071280+0000","last_clean":"2024-09-10T09:23:17.071280+0000","last_became_active":"2024-09-10T09:23:14.092775+0000","last_became_peered":"2024-09-10T09:23:14.092775+0000","last_unstale":"2024-09-10T09:23:17.071280+0000","last_undegraded":"2024-09-10T09:23:17.071280+0000","last_fullsized":"2024-09-10T09:23:17.071280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:09.909052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.115062+0000","last_change":"2024-09-10T09:23:15.107859+0000","last_active":"2024-09-10T09:23:15.115062+0000","last_peered":"2024-09-10T09:23:15.115062+0000","last_clean":"2024-09-10T09:23:15.115062+0000","last_became_active":"2024-09-10T09:23:15.107225+0000","last_became_peered":"2024-09-10T09:23:15.107225+0000","last_unstale":"2024-09-10T09:23:15.115062+0000","last_undegraded":"2024-09-10T09:23:15.115062+0000","last_fullsized":"2024-09-10T09:23:15.115062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:02.879398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108104+0000","last_change":"2024-09-10T09:23:14.086690+0000","last_active":"2024-09-10T09:23:16.108104+0000","last_peered":"2024-09-10T09:23:16.108104+0000","last_clean":"2024-09-10T09:23:16.108104+0000","last_became_active":"2024-09-10T09:23:14.086422+0000","last_became_peered":"2024-09-10T09:23:14.086422+0000","last_unstale":"2024-09-10T09:23:16.108104+0000","last_undegraded":"2024-09-10T09:23:16.108104+0000","last_fullsized":"2024-09-10T09:23:16.108104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:15.464088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040365+0000","last_change":"2024-09-10T09:23:15.108731+0000","last_active":"2024-09-10T09:23:17.040365+0000","last_peered":"2024-09-10T09:23:17.040365+0000","last_clean":"2024-09-10T09:23:17.040365+0000","last_became_active":"2024-09-10T09:23:15.108454+0000","last_became_peered":"2024-09-10T09:23:15.108454+0000","last_unstale":"2024-09-10T09:23:17.040365+0000","last_undegraded":"2024-09-10T09:23:17.040365+0000","last_fullsized":"2024-09-10T09:23:17.040365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:57.258464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106958+0000","last_change":"2024-09-10T09:23:14.083386+0000","last_active":"2024-09-10T09:23:16.106958+0000","last_peered":"2024-09-10T09:23:16.106958+0000","last_clean":"2024-09-10T09:23:16.106958+0000","last_became_active":"2024-09-10T09:23:14.083122+0000","last_became_peered":"2024-09-10T09:23:14.083122+0000","last_unstale":"2024-09-10T09:23:16.106958+0000","last_undegraded":"2024-09-10T09:23:16.106958+0000","last_fullsized":"2024-09-10T09:23:16.106958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:39.168289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.109485+0000","last_change":"2024-09-10T09:23:15.104173+0000","last_active":"2024-09-10T09:23:15.109485+0000","last_peered":"2024-09-10T09:23:15.109485+0000","last_clean":"2024-09-10T09:23:15.109485+0000","last_became_active":"2024-09-10T09:23:15.103881+0000","last_became_peered":"2024-09-10T09:23:15.103881+0000","last_unstale":"2024-09-10T09:23:15.109485+0000","last_undegraded":"2024-09-10T09:23:15.109485+0000","last_fullsized":"2024-09-10T09:23:15.109485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:07.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117137+0000","last_change":"2024-09-10T09:23:14.093161+0000","last_active":"2024-09-10T09:23:16.117137+0000","last_peered":"2024-09-10T09:23:16.117137+0000","last_clean":"2024-09-10T09:23:16.117137+0000","last_became_active":"2024-09-10T09:23:14.092626+0000","last_became_peered":"2024-09-10T09:23:14.092626+0000","last_unstale":"2024-09-10T09:23:16.117137+0000","last_undegraded":"2024-09-10T09:23:16.117137+0000","last_fullsized":"2024-09-10T09:23:16.117137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:48.558743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107722+0000","last_change":"2024-09-10T09:23:15.113575+0000","last_active":"2024-09-10T09:23:16.107722+0000","last_peered":"2024-09-10T09:23:16.107722+0000","last_clean":"2024-09-10T09:23:16.107722+0000","last_became_active":"2024-09-10T09:23:15.113295+0000","last_became_peered":"2024-09-10T09:23:15.113295+0000","last_unstale":"2024-09-10T09:23:16.107722+0000","last_undegraded":"2024-09-10T09:23:16.107722+0000","last_fullsized":"2024-09-10T09:23:16.107722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:43.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.113964+0000","last_change":"2024-09-10T09:23:14.093884+0000","last_active":"2024-09-10T09:23:16.113964+0000","last_peered":"2024-09-10T09:23:16.113964+0000","last_clean":"2024-09-10T09:23:16.113964+0000","last_became_active":"2024-09-10T09:23:14.093340+0000","last_became_peered":"2024-09-10T09:23:14.093340+0000","last_unstale":"2024-09-10T09:23:16.113964+0000","last_undegraded":"2024-09-10T09:23:16.113964+0000","last_fullsized":"2024-09-10T09:23:16.113964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:39.168289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106116+0000","last_change":"2024-09-10T09:23:15.107911+0000","last_active":"2024-09-10T09:23:16.106116+0000","last_peered":"2024-09-10T09:23:16.106116+0000","last_clean":"2024-09-10T09:23:16.106116+0000","last_became_active":"2024-09-10T09:23:15.107577+0000","last_became_peered":"2024-09-10T09:23:15.107577+0000","last_unstale":"2024-09-10T09:23:16.106116+0000","last_undegraded":"2024-09-10T09:23:16.106116+0000","last_fullsized":"2024-09-10T09:23:16.106116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:02.585818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116928+0000","last_change":"2024-09-10T09:23:14.092986+0000","last_active":"2024-09-10T09:23:16.116928+0000","last_peered":"2024-09-10T09:23:16.116928+0000","last_clean":"2024-09-10T09:23:16.116928+0000","last_became_active":"2024-09-10T09:23:14.092734+0000","last_became_peered":"2024-09-10T09:23:14.092734+0000","last_unstale":"2024-09-10T09:23:16.116928+0000","last_undegraded":"2024-09-10T09:23:16.116928+0000","last_fullsized":"2024-09-10T09:23:16.116928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:32.932117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071308+0000","last_change":"2024-09-10T09:23:15.101712+0000","last_active":"2024-09-10T09:23:17.071308+0000","last_peered":"2024-09-10T09:23:17.071308+0000","last_clean":"2024-09-10T09:23:17.071308+0000","last_became_active":"2024-09-10T09:23:15.101472+0000","last_became_peered":"2024-09-10T09:23:15.101472+0000","last_unstale":"2024-09-10T09:23:17.071308+0000","last_undegraded":"2024-09-10T09:23:17.071308+0000","last_fullsized":"2024-09-10T09:23:17.071308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:09.216437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106324+0000","last_change":"2024-09-10T09:23:14.086050+0000","last_active":"2024-09-10T09:23:16.106324+0000","last_peered":"2024-09-10T09:23:16.106324+0000","last_clean":"2024-09-10T09:23:16.106324+0000","last_became_active":"2024-09-10T09:23:14.085616+0000","last_became_peered":"2024-09-10T09:23:14.085616+0000","last_unstale":"2024-09-10T09:23:16.106324+0000","last_undegraded":"2024-09-10T09:23:16.106324+0000","last_fullsized":"2024-09-10T09:23:16.106324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:02.526532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106247+0000","last_change":"2024-09-10T09:23:15.110006+0000","last_active":"2024-09-10T09:23:16.106247+0000","last_peered":"2024-09-10T09:23:16.106247+0000","last_clean":"2024-09-10T09:23:16.106247+0000","last_became_active":"2024-09-10T09:23:15.109700+0000","last_became_peered":"2024-09-10T09:23:15.109700+0000","last_unstale":"2024-09-10T09:23:16.106247+0000","last_undegraded":"2024-09-10T09:23:16.106247+0000","last_fullsized":"2024-09-10T09:23:16.106247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.436638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116682+0000","last_change":"2024-09-10T09:23:14.092726+0000","last_active":"2024-09-10T09:23:16.116682+0000","last_peered":"2024-09-10T09:23:16.116682+0000","last_clean":"2024-09-10T09:23:16.116682+0000","last_became_active":"2024-09-10T09:23:14.092425+0000","last_became_peered":"2024-09-10T09:23:14.092425+0000","last_unstale":"2024-09-10T09:23:16.116682+0000","last_undegraded":"2024-09-10T09:23:16.116682+0000","last_fullsized":"2024-09-10T09:23:16.116682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:27.131435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527332+0000","last_change":"2024-09-10T09:23:15.110209+0000","last_active":"2024-09-10T09:23:16.527332+0000","last_peered":"2024-09-10T09:23:16.527332+0000","last_clean":"2024-09-10T09:23:16.527332+0000","last_became_active":"2024-09-10T09:23:15.109868+0000","last_became_peered":"2024-09-10T09:23:15.109868+0000","last_unstale":"2024-09-10T09:23:16.527332+0000","last_undegraded":"2024-09-10T09:23:16.527332+0000","last_fullsized":"2024-09-10T09:23:16.527332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:15.208451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108186+0000","last_change":"2024-09-10T09:23:14.085099+0000","last_active":"2024-09-10T09:23:16.108186+0000","last_peered":"2024-09-10T09:23:16.108186+0000","last_clean":"2024-09-10T09:23:16.108186+0000","last_became_active":"2024-09-10T09:23:14.084828+0000","last_became_peered":"2024-09-10T09:23:14.084828+0000","last_unstale":"2024-09-10T09:23:16.108186+0000","last_undegraded":"2024-09-10T09:23:16.108186+0000","last_fullsized":"2024-09-10T09:23:16.108186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:51.177494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108077+0000","last_change":"2024-09-10T09:23:15.111648+0000","last_active":"2024-09-10T09:23:16.108077+0000","last_peered":"2024-09-10T09:23:16.108077+0000","last_clean":"2024-09-10T09:23:16.108077+0000","last_became_active":"2024-09-10T09:23:15.111331+0000","last_became_peered":"2024-09-10T09:23:15.111331+0000","last_unstale":"2024-09-10T09:23:16.108077+0000","last_undegraded":"2024-09-10T09:23:16.108077+0000","last_fullsized":"2024-09-10T09:23:16.108077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.098727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527362+0000","last_change":"2024-09-10T09:23:14.089474+0000","last_active":"2024-09-10T09:23:16.527362+0000","last_peered":"2024-09-10T09:23:16.527362+0000","last_clean":"2024-09-10T09:23:16.527362+0000","last_became_active":"2024-09-10T09:23:14.089168+0000","last_became_peered":"2024-09-10T09:23:14.089168+0000","last_unstale":"2024-09-10T09:23:16.527362+0000","last_undegraded":"2024-09-10T09:23:16.527362+0000","last_fullsized":"2024-09-10T09:23:16.527362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:42.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040524+0000","last_change":"2024-09-10T09:23:15.107175+0000","last_active":"2024-09-10T09:23:17.040524+0000","last_peered":"2024-09-10T09:23:17.040524+0000","last_clean":"2024-09-10T09:23:17.040524+0000","last_became_active":"2024-09-10T09:23:15.106920+0000","last_became_peered":"2024-09-10T09:23:15.106920+0000","last_unstale":"2024-09-10T09:23:17.040524+0000","last_undegraded":"2024-09-10T09:23:17.040524+0000","last_fullsized":"2024-09-10T09:23:17.040524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:01.134511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071363+0000","last_change":"2024-09-10T09:23:14.090158+0000","last_active":"2024-09-10T09:23:17.071363+0000","last_peered":"2024-09-10T09:23:17.071363+0000","last_clean":"2024-09-10T09:23:17.071363+0000","last_became_active":"2024-09-10T09:23:14.089870+0000","last_became_peered":"2024-09-10T09:23:14.089870+0000","last_unstale":"2024-09-10T09:23:17.071363+0000","last_undegraded":"2024-09-10T09:23:17.071363+0000","last_fullsized":"2024-09-10T09:23:17.071363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:19.466783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040016+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:17.040016+0000","last_peered":"2024-09-10T09:23:17.040016+0000","last_clean":"2024-09-10T09:23:17.040016+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:17.040016+0000","last_undegraded":"2024-09-10T09:23:17.040016+0000","last_fullsized":"2024-09-10T09:23:17.040016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":942080,"data_stored":721439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":137897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":137953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":137385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":131051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":727649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:22.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:22.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.632+0000 7f58217bd640 1 Processor -- start 2024-09-10T09:23:22.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.632+0000 7f58217bd640 1 -- start start 2024-09-10T09:23:22.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.633+0000 7f58217bd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f581c0b5690 0x7f581c06daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.633+0000 7f58217bd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 0x7f581c06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.633+0000 7f58217bd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581c06cd50 con 0x7f581c15eb20 2024-09-10T09:23:22.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.633+0000 7f58217bd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f581c06d610 con 0x7f581c0b5690 2024-09-10T09:23:22.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.633+0000 7f58217bd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f581c06cfc0 con 0x7f581c073c20 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 0x7f581c06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581a7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f581c0b5690 0x7f581c06daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581affd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f581c15eb20 0x7f581c0b6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:49334/0 (socket says 172.21.15.12:49334) 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 0x7f581c06dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:44602/0 (socket says 172.21.15.12:44602) 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 -- 172.21.15.12:0/1107563728 learned_addr learned my addr 172.21.15.12:0/1107563728 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 -- 172.21.15.12:0/1107563728 >> v2:172.21.15.100:3300/0 conn(0x7f581c0b5690 msgr2=0x7f581c06daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 --2- 172.21.15.12:0/1107563728 >> v2:172.21.15.100:3300/0 conn(0x7f581c0b5690 0x7f581c06daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 -- 172.21.15.12:0/1107563728 >> v1:172.21.15.100:6789/0 conn(0x7f581c15eb20 legacy=0x7f581c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581b7fe640 1 -- 172.21.15.12:0/1107563728 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c06d2a0 con 0x7f581c073c20 2024-09-10T09:23:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.634+0000 7f581a7fc640 1 --2- 172.21.15.12:0/1107563728 >> v2:172.21.15.100:3300/0 conn(0x7f581c0b5690 0x7f581c06daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:22.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.635+0000 7f581b7fe640 1 --2- 172.21.15.12:0/1107563728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 0x7f581c06dfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f580c009e50 tx=0x7f580c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb6878ad2222105 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:22.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.635+0000 7f5819ffb640 1 -- 172.21.15.12:0/1107563728 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c036070 con 0x7f581c073c20 2024-09-10T09:23:22.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.635+0000 7f5819ffb640 1 -- 172.21.15.12:0/1107563728 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c031600 con 0x7f581c073c20 2024-09-10T09:23:22.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.635+0000 7f5819ffb640 1 -- 172.21.15.12:0/1107563728 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c0319d0 con 0x7f581c073c20 2024-09-10T09:23:22.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 -- 172.21.15.12:0/1107563728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 msgr2=0x7f581c06dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 --2- 172.21.15.12:0/1107563728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 0x7f581c06dfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f580c009e50 tx=0x7f580c02a710 comp rx=0 tx=0).stop 2024-09-10T09:23:22.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 -- 172.21.15.12:0/1107563728 shutdown_connections 2024-09-10T09:23:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 --2- 172.21.15.12:0/1107563728 >> v2:172.21.15.100:3300/0 conn(0x7f581c0b5690 0x7f581c06daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 --2- 172.21.15.12:0/1107563728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c073c20 0x7f581c06dfe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 -- 172.21.15.12:0/1107563728 >> 172.21.15.12:0/1107563728 conn(0x7f581c062630 msgr2=0x7f581c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 -- 172.21.15.12:0/1107563728 shutdown_connections 2024-09-10T09:23:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.636+0000 7f58217bd640 1 -- 172.21.15.12:0/1107563728 wait complete. 2024-09-10T09:23:22.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.637+0000 7f58217bd640 1 Processor -- start 2024-09-10T09:23:22.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.637+0000 7f58217bd640 1 -- start start 2024-09-10T09:23:22.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f58217bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 0x7f581c1f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f58217bd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0b5690 0x7f581c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f58217bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c15eb20 0x7f581c161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f58217bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f581c0b7650 con 0x7f581c073c20 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f58217bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f581c0b74d0 con 0x7f581c15eb20 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f58217bd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f581c0b77d0 con 0x7f581c0b5690 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 0x7f581c1f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 0x7f581c1f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33264/0 (socket says 172.21.15.12:33264) 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 -- 172.21.15.12:0/1699447311 learned_addr learned my addr 172.21.15.12:0/1699447311 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581a7fc640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0b5690 0x7f581c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581b7fe640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c15eb20 0x7f581c161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 -- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0b5690 msgr2=0x7f581c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0b5690 0x7f581c160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 -- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c15eb20 msgr2=0x7f581c161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c15eb20 0x7f581c161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.638+0000 7f581affd640 1 -- 172.21.15.12:0/1699447311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c1f9050 con 0x7f581c073c20 2024-09-10T09:23:22.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.639+0000 7f581affd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 0x7f581c1f8b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f581400c3c0 tx=0x7f581400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.639+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58140074e0 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.639+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c0d08b0 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.639+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5814007680 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.639+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814004a00 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.639+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c0d0e70 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.640+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581c0d1fe0 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.641+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f581401a020 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.641+0000 7f58137fe640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f57fc06be30 0x7f57fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.641+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f581408a460 con 0x7f581c073c20 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.641+0000 7f581a7fc640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f57fc06be30 0x7f57fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.642+0000 7f581a7fc640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f57fc06be30 0x7f57fc06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f581c0ce010 tx=0x7f5804009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:22.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.646+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f581c1f9050 con 0x7f581c073c20 2024-09-10T09:23:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.819+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f581c06e1c0 con 0x7f57fc06be30 2024-09-10T09:23:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.826+0000 7f58137fe640 1 -- 172.21.15.12:0/1699447311 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f581c06e1c0 con 0x7f57fc06be30 2024-09-10T09:23:22.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:22.834 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f57fc06be30 msgr2=0x7f57fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f57fc06be30 0x7f57fc06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f581c0ce010 tx=0x7f5804009190 comp rx=0 tx=0).stop 2024-09-10T09:23:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 msgr2=0x7f581c1f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 0x7f581c1f8b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f581400c3c0 tx=0x7f581400c880 comp rx=0 tx=0).stop 2024-09-10T09:23:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 shutdown_connections 2024-09-10T09:23:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f57fc06be30 0x7f57fc06e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c15eb20 0x7f581c161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0b5690 0x7f581c160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 --2- 172.21.15.12:0/1699447311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c073c20 0x7f581c1f8b10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 >> 172.21.15.12:0/1699447311 conn(0x7f581c062630 msgr2=0x7f581c0cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 shutdown_connections 2024-09-10T09:23:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.829+0000 7f58217bd640 1 -- 172.21.15.12:0/1699447311 wait complete. 2024-09-10T09:23:22.845 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-10T09:23:21.231107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220236,"kb_used_data":3984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754484,"statfs":{"total":773094113280,"available":772868591616,"internally_reserved":0,"allocated":4079616,"data_stored":2271204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.157981"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071525+0000","last_change":"2024-09-10T09:23:15.109116+0000","last_active":"2024-09-10T09:23:17.071525+0000","last_peered":"2024-09-10T09:23:17.071525+0000","last_clean":"2024-09-10T09:23:17.071525+0000","last_became_active":"2024-09-10T09:23:15.108872+0000","last_became_peered":"2024-09-10T09:23:15.108872+0000","last_unstale":"2024-09-10T09:23:17.071525+0000","last_undegraded":"2024-09-10T09:23:17.071525+0000","last_fullsized":"2024-09-10T09:23:17.071525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:02.585818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527729+0000","last_change":"2024-09-10T09:23:15.100791+0000","last_active":"2024-09-10T09:23:16.527729+0000","last_peered":"2024-09-10T09:23:16.527729+0000","last_clean":"2024-09-10T09:23:16.527729+0000","last_became_active":"2024-09-10T09:23:15.100332+0000","last_became_peered":"2024-09-10T09:23:15.100332+0000","last_unstale":"2024-09-10T09:23:16.527729+0000","last_undegraded":"2024-09-10T09:23:16.527729+0000","last_fullsized":"2024-09-10T09:23:16.527729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:44:12.116099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107458+0000","last_change":"2024-09-10T09:23:15.113602+0000","last_active":"2024-09-10T09:23:16.107458+0000","last_peered":"2024-09-10T09:23:16.107458+0000","last_clean":"2024-09-10T09:23:16.107458+0000","last_became_active":"2024-09-10T09:23:15.113337+0000","last_became_peered":"2024-09-10T09:23:15.113337+0000","last_unstale":"2024-09-10T09:23:16.107458+0000","last_undegraded":"2024-09-10T09:23:16.107458+0000","last_fullsized":"2024-09-10T09:23:16.107458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:59.859840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116789+0000","last_change":"2024-09-10T09:23:15.114029+0000","last_active":"2024-09-10T09:23:16.116789+0000","last_peered":"2024-09-10T09:23:16.116789+0000","last_clean":"2024-09-10T09:23:16.116789+0000","last_became_active":"2024-09-10T09:23:15.113703+0000","last_became_peered":"2024-09-10T09:23:15.113703+0000","last_unstale":"2024-09-10T09:23:16.116789+0000","last_undegraded":"2024-09-10T09:23:16.116789+0000","last_fullsized":"2024-09-10T09:23:16.116789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:49.996219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.109441+0000","last_change":"2024-09-10T09:23:15.105129+0000","last_active":"2024-09-10T09:23:15.109441+0000","last_peered":"2024-09-10T09:23:15.109441+0000","last_clean":"2024-09-10T09:23:15.109441+0000","last_became_active":"2024-09-10T09:23:15.104837+0000","last_became_peered":"2024-09-10T09:23:15.104837+0000","last_unstale":"2024-09-10T09:23:15.109441+0000","last_undegraded":"2024-09-10T09:23:15.109441+0000","last_fullsized":"2024-09-10T09:23:15.109441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:17.738837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527376+0000","last_change":"2024-09-10T09:23:15.103633+0000","last_active":"2024-09-10T09:23:16.527376+0000","last_peered":"2024-09-10T09:23:16.527376+0000","last_clean":"2024-09-10T09:23:16.527376+0000","last_became_active":"2024-09-10T09:23:15.103338+0000","last_became_peered":"2024-09-10T09:23:15.103338+0000","last_unstale":"2024-09-10T09:23:16.527376+0000","last_undegraded":"2024-09-10T09:23:16.527376+0000","last_fullsized":"2024-09-10T09:23:16.527376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:57.019724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040535+0000","last_change":"2024-09-10T09:23:15.109608+0000","last_active":"2024-09-10T09:23:17.040535+0000","last_peered":"2024-09-10T09:23:17.040535+0000","last_clean":"2024-09-10T09:23:17.040535+0000","last_became_active":"2024-09-10T09:23:15.109275+0000","last_became_peered":"2024-09-10T09:23:15.109275+0000","last_unstale":"2024-09-10T09:23:17.040535+0000","last_undegraded":"2024-09-10T09:23:17.040535+0000","last_fullsized":"2024-09-10T09:23:17.040535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:51.430861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040279+0000","last_change":"2024-09-10T09:23:15.108441+0000","last_active":"2024-09-10T09:23:17.040279+0000","last_peered":"2024-09-10T09:23:17.040279+0000","last_clean":"2024-09-10T09:23:17.040279+0000","last_became_active":"2024-09-10T09:23:15.108168+0000","last_became_peered":"2024-09-10T09:23:15.108168+0000","last_unstale":"2024-09-10T09:23:17.040279+0000","last_undegraded":"2024-09-10T09:23:17.040279+0000","last_fullsized":"2024-09-10T09:23:17.040279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:09.673003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108672+0000","last_change":"2024-09-10T09:23:15.112735+0000","last_active":"2024-09-10T09:23:16.108672+0000","last_peered":"2024-09-10T09:23:16.108672+0000","last_clean":"2024-09-10T09:23:16.108672+0000","last_became_active":"2024-09-10T09:23:15.112477+0000","last_became_peered":"2024-09-10T09:23:15.112477+0000","last_unstale":"2024-09-10T09:23:16.108672+0000","last_undegraded":"2024-09-10T09:23:16.108672+0000","last_fullsized":"2024-09-10T09:23:16.108672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:54.342264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116895+0000","last_change":"2024-09-10T09:23:15.112042+0000","last_active":"2024-09-10T09:23:16.116895+0000","last_peered":"2024-09-10T09:23:16.116895+0000","last_clean":"2024-09-10T09:23:16.116895+0000","last_became_active":"2024-09-10T09:23:15.111711+0000","last_became_peered":"2024-09-10T09:23:15.111711+0000","last_unstale":"2024-09-10T09:23:16.116895+0000","last_undegraded":"2024-09-10T09:23:16.116895+0000","last_fullsized":"2024-09-10T09:23:16.116895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:16.998035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040608+0000","last_change":"2024-09-10T09:23:15.108849+0000","last_active":"2024-09-10T09:23:17.040608+0000","last_peered":"2024-09-10T09:23:17.040608+0000","last_clean":"2024-09-10T09:23:17.040608+0000","last_became_active":"2024-09-10T09:23:15.108600+0000","last_became_peered":"2024-09-10T09:23:15.108600+0000","last_unstale":"2024-09-10T09:23:17.040608+0000","last_undegraded":"2024-09-10T09:23:17.040608+0000","last_fullsized":"2024-09-10T09:23:17.040608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:36.212745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107380+0000","last_change":"2024-09-10T09:23:15.102459+0000","last_active":"2024-09-10T09:23:16.107380+0000","last_peered":"2024-09-10T09:23:16.107380+0000","last_clean":"2024-09-10T09:23:16.107380+0000","last_became_active":"2024-09-10T09:23:15.102203+0000","last_became_peered":"2024-09-10T09:23:15.102203+0000","last_unstale":"2024-09-10T09:23:16.107380+0000","last_undegraded":"2024-09-10T09:23:16.107380+0000","last_fullsized":"2024-09-10T09:23:16.107380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:47.787487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120823+0000","last_change":"2024-09-10T09:23:15.113990+0000","last_active":"2024-09-10T09:23:15.120823+0000","last_peered":"2024-09-10T09:23:15.120823+0000","last_clean":"2024-09-10T09:23:15.120823+0000","last_became_active":"2024-09-10T09:23:15.113678+0000","last_became_peered":"2024-09-10T09:23:15.113678+0000","last_unstale":"2024-09-10T09:23:15.120823+0000","last_undegraded":"2024-09-10T09:23:15.120823+0000","last_fullsized":"2024-09-10T09:23:15.120823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:28.443128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527607+0000","last_change":"2024-09-10T09:23:15.106201+0000","last_active":"2024-09-10T09:23:16.527607+0000","last_peered":"2024-09-10T09:23:16.527607+0000","last_clean":"2024-09-10T09:23:16.527607+0000","last_became_active":"2024-09-10T09:23:15.105537+0000","last_became_peered":"2024-09-10T09:23:15.105537+0000","last_unstale":"2024-09-10T09:23:16.527607+0000","last_undegraded":"2024-09-10T09:23:16.527607+0000","last_fullsized":"2024-09-10T09:23:16.527607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:58.628909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107256+0000","last_change":"2024-09-10T09:23:15.101655+0000","last_active":"2024-09-10T09:23:16.107256+0000","last_peered":"2024-09-10T09:23:16.107256+0000","last_clean":"2024-09-10T09:23:16.107256+0000","last_became_active":"2024-09-10T09:23:15.101399+0000","last_became_peered":"2024-09-10T09:23:15.101399+0000","last_unstale":"2024-09-10T09:23:16.107256+0000","last_undegraded":"2024-09-10T09:23:16.107256+0000","last_fullsized":"2024-09-10T09:23:16.107256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:51.430861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040677+0000","last_change":"2024-09-10T09:23:15.112870+0000","last_active":"2024-09-10T09:23:17.040677+0000","last_peered":"2024-09-10T09:23:17.040677+0000","last_clean":"2024-09-10T09:23:17.040677+0000","last_became_active":"2024-09-10T09:23:15.110570+0000","last_became_peered":"2024-09-10T09:23:15.110570+0000","last_unstale":"2024-09-10T09:23:17.040677+0000","last_undegraded":"2024-09-10T09:23:17.040677+0000","last_fullsized":"2024-09-10T09:23:17.040677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:59.859840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040691+0000","last_change":"2024-09-10T09:23:15.111793+0000","last_active":"2024-09-10T09:23:17.040691+0000","last_peered":"2024-09-10T09:23:17.040691+0000","last_clean":"2024-09-10T09:23:17.040691+0000","last_became_active":"2024-09-10T09:23:15.110636+0000","last_became_peered":"2024-09-10T09:23:15.110636+0000","last_unstale":"2024-09-10T09:23:17.040691+0000","last_undegraded":"2024-09-10T09:23:17.040691+0000","last_fullsized":"2024-09-10T09:23:17.040691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:35.730918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527856+0000","last_change":"2024-09-10T09:23:15.112593+0000","last_active":"2024-09-10T09:23:16.527856+0000","last_peered":"2024-09-10T09:23:16.527856+0000","last_clean":"2024-09-10T09:23:16.527856+0000","last_became_active":"2024-09-10T09:23:15.112323+0000","last_became_peered":"2024-09-10T09:23:15.112323+0000","last_unstale":"2024-09-10T09:23:16.527856+0000","last_undegraded":"2024-09-10T09:23:16.527856+0000","last_fullsized":"2024-09-10T09:23:16.527856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:50.246172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527659+0000","last_change":"2024-09-10T09:23:15.112647+0000","last_active":"2024-09-10T09:23:16.527659+0000","last_peered":"2024-09-10T09:23:16.527659+0000","last_clean":"2024-09-10T09:23:16.527659+0000","last_became_active":"2024-09-10T09:23:15.112347+0000","last_became_peered":"2024-09-10T09:23:15.112347+0000","last_unstale":"2024-09-10T09:23:16.527659+0000","last_undegraded":"2024-09-10T09:23:16.527659+0000","last_fullsized":"2024-09-10T09:23:16.527659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:08.835262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120815+0000","last_change":"2024-09-10T09:23:15.113396+0000","last_active":"2024-09-10T09:23:15.120815+0000","last_peered":"2024-09-10T09:23:15.120815+0000","last_clean":"2024-09-10T09:23:15.120815+0000","last_became_active":"2024-09-10T09:23:15.113135+0000","last_became_peered":"2024-09-10T09:23:15.113135+0000","last_unstale":"2024-09-10T09:23:15.120815+0000","last_undegraded":"2024-09-10T09:23:15.120815+0000","last_fullsized":"2024-09-10T09:23:15.120815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:19.929957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108174+0000","last_change":"2024-09-10T09:23:15.107171+0000","last_active":"2024-09-10T09:23:16.108174+0000","last_peered":"2024-09-10T09:23:16.108174+0000","last_clean":"2024-09-10T09:23:16.108174+0000","last_became_active":"2024-09-10T09:23:15.106891+0000","last_became_peered":"2024-09-10T09:23:15.106891+0000","last_unstale":"2024-09-10T09:23:16.108174+0000","last_undegraded":"2024-09-10T09:23:16.108174+0000","last_fullsized":"2024-09-10T09:23:16.108174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:33.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108636+0000","last_change":"2024-09-10T09:23:15.103781+0000","last_active":"2024-09-10T09:23:16.108636+0000","last_peered":"2024-09-10T09:23:16.108636+0000","last_clean":"2024-09-10T09:23:16.108636+0000","last_became_active":"2024-09-10T09:23:15.103412+0000","last_became_peered":"2024-09-10T09:23:15.103412+0000","last_unstale":"2024-09-10T09:23:16.108636+0000","last_undegraded":"2024-09-10T09:23:16.108636+0000","last_fullsized":"2024-09-10T09:23:16.108636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:06:44.497740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.105979+0000","last_change":"2024-09-10T09:23:15.105473+0000","last_active":"2024-09-10T09:23:16.105979+0000","last_peered":"2024-09-10T09:23:16.105979+0000","last_clean":"2024-09-10T09:23:16.105979+0000","last_became_active":"2024-09-10T09:23:15.105179+0000","last_became_peered":"2024-09-10T09:23:15.105179+0000","last_unstale":"2024-09-10T09:23:16.105979+0000","last_undegraded":"2024-09-10T09:23:16.105979+0000","last_fullsized":"2024-09-10T09:23:16.105979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:35.766176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107033+0000","last_change":"2024-09-10T09:23:15.105839+0000","last_active":"2024-09-10T09:23:16.107033+0000","last_peered":"2024-09-10T09:23:16.107033+0000","last_clean":"2024-09-10T09:23:16.107033+0000","last_became_active":"2024-09-10T09:23:15.105375+0000","last_became_peered":"2024-09-10T09:23:15.105375+0000","last_unstale":"2024-09-10T09:23:16.107033+0000","last_undegraded":"2024-09-10T09:23:16.107033+0000","last_fullsized":"2024-09-10T09:23:16.107033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:57.258464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117003+0000","last_change":"2024-09-10T09:23:15.110193+0000","last_active":"2024-09-10T09:23:16.117003+0000","last_peered":"2024-09-10T09:23:16.117003+0000","last_clean":"2024-09-10T09:23:16.117003+0000","last_became_active":"2024-09-10T09:23:15.108944+0000","last_became_peered":"2024-09-10T09:23:15.108944+0000","last_unstale":"2024-09-10T09:23:16.117003+0000","last_undegraded":"2024-09-10T09:23:16.117003+0000","last_fullsized":"2024-09-10T09:23:16.117003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:41.257440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527891+0000","last_change":"2024-09-10T09:23:15.110687+0000","last_active":"2024-09-10T09:23:16.527891+0000","last_peered":"2024-09-10T09:23:16.527891+0000","last_clean":"2024-09-10T09:23:16.527891+0000","last_became_active":"2024-09-10T09:23:15.110418+0000","last_became_peered":"2024-09-10T09:23:15.110418+0000","last_unstale":"2024-09-10T09:23:16.527891+0000","last_undegraded":"2024-09-10T09:23:16.527891+0000","last_fullsized":"2024-09-10T09:23:16.527891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:50.548033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117123+0000","last_change":"2024-09-10T09:23:15.112856+0000","last_active":"2024-09-10T09:23:16.117123+0000","last_peered":"2024-09-10T09:23:16.117123+0000","last_clean":"2024-09-10T09:23:16.117123+0000","last_became_active":"2024-09-10T09:23:15.112579+0000","last_became_peered":"2024-09-10T09:23:15.112579+0000","last_unstale":"2024-09-10T09:23:16.117123+0000","last_undegraded":"2024-09-10T09:23:16.117123+0000","last_fullsized":"2024-09-10T09:23:16.117123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.096970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107403+0000","last_change":"2024-09-10T09:23:15.101677+0000","last_active":"2024-09-10T09:23:16.107403+0000","last_peered":"2024-09-10T09:23:16.107403+0000","last_clean":"2024-09-10T09:23:16.107403+0000","last_became_active":"2024-09-10T09:23:15.101414+0000","last_became_peered":"2024-09-10T09:23:15.101414+0000","last_unstale":"2024-09-10T09:23:16.107403+0000","last_undegraded":"2024-09-10T09:23:16.107403+0000","last_fullsized":"2024-09-10T09:23:16.107403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:36.212745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108379+0000","last_change":"2024-09-10T09:23:15.110939+0000","last_active":"2024-09-10T09:23:16.108379+0000","last_peered":"2024-09-10T09:23:16.108379+0000","last_clean":"2024-09-10T09:23:16.108379+0000","last_became_active":"2024-09-10T09:23:15.110562+0000","last_became_peered":"2024-09-10T09:23:15.110562+0000","last_unstale":"2024-09-10T09:23:16.108379+0000","last_undegraded":"2024-09-10T09:23:16.108379+0000","last_fullsized":"2024-09-10T09:23:16.108379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:24.794929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040263+0000","last_change":"2024-09-10T09:23:15.112314+0000","last_active":"2024-09-10T09:23:17.040263+0000","last_peered":"2024-09-10T09:23:17.040263+0000","last_clean":"2024-09-10T09:23:17.040263+0000","last_became_active":"2024-09-10T09:23:15.110509+0000","last_became_peered":"2024-09-10T09:23:15.110509+0000","last_unstale":"2024-09-10T09:23:17.040263+0000","last_undegraded":"2024-09-10T09:23:17.040263+0000","last_fullsized":"2024-09-10T09:23:17.040263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:31.611745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071350+0000","last_change":"2024-09-10T09:23:15.108792+0000","last_active":"2024-09-10T09:23:17.071350+0000","last_peered":"2024-09-10T09:23:17.071350+0000","last_clean":"2024-09-10T09:23:17.071350+0000","last_became_active":"2024-09-10T09:23:15.108503+0000","last_became_peered":"2024-09-10T09:23:15.108503+0000","last_unstale":"2024-09-10T09:23:17.071350+0000","last_undegraded":"2024-09-10T09:23:17.071350+0000","last_fullsized":"2024-09-10T09:23:17.071350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:24.917910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040323+0000","last_change":"2024-09-10T09:23:15.114025+0000","last_active":"2024-09-10T09:23:17.040323+0000","last_peered":"2024-09-10T09:23:17.040323+0000","last_clean":"2024-09-10T09:23:17.040323+0000","last_became_active":"2024-09-10T09:23:15.113786+0000","last_became_peered":"2024-09-10T09:23:15.113786+0000","last_unstale":"2024-09-10T09:23:17.040323+0000","last_undegraded":"2024-09-10T09:23:17.040323+0000","last_fullsized":"2024-09-10T09:23:17.040323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:45.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106123+0000","last_change":"2024-09-10T09:23:15.108603+0000","last_active":"2024-09-10T09:23:16.106123+0000","last_peered":"2024-09-10T09:23:16.106123+0000","last_clean":"2024-09-10T09:23:16.106123+0000","last_became_active":"2024-09-10T09:23:15.108228+0000","last_became_peered":"2024-09-10T09:23:15.108228+0000","last_unstale":"2024-09-10T09:23:16.106123+0000","last_undegraded":"2024-09-10T09:23:16.106123+0000","last_fullsized":"2024-09-10T09:23:16.106123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:56.264172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071595+0000","last_change":"2024-09-10T09:23:14.091840+0000","last_active":"2024-09-10T09:23:17.071595+0000","last_peered":"2024-09-10T09:23:17.071595+0000","last_clean":"2024-09-10T09:23:17.071595+0000","last_became_active":"2024-09-10T09:23:14.091522+0000","last_became_peered":"2024-09-10T09:23:14.091522+0000","last_unstale":"2024-09-10T09:23:17.071595+0000","last_undegraded":"2024-09-10T09:23:17.071595+0000","last_fullsized":"2024-09-10T09:23:17.071595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:22.619886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071535+0000","last_change":"2024-09-10T09:23:15.111579+0000","last_active":"2024-09-10T09:23:17.071535+0000","last_peered":"2024-09-10T09:23:17.071535+0000","last_clean":"2024-09-10T09:23:17.071535+0000","last_became_active":"2024-09-10T09:23:15.111305+0000","last_became_peered":"2024-09-10T09:23:15.111305+0000","last_unstale":"2024-09-10T09:23:17.071535+0000","last_undegraded":"2024-09-10T09:23:17.071535+0000","last_fullsized":"2024-09-10T09:23:17.071535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:56.264172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106129+0000","last_change":"2024-09-10T09:23:14.087708+0000","last_active":"2024-09-10T09:23:16.106129+0000","last_peered":"2024-09-10T09:23:16.106129+0000","last_clean":"2024-09-10T09:23:16.106129+0000","last_became_active":"2024-09-10T09:23:14.087333+0000","last_became_peered":"2024-09-10T09:23:14.087333+0000","last_unstale":"2024-09-10T09:23:16.106129+0000","last_undegraded":"2024-09-10T09:23:16.106129+0000","last_fullsized":"2024-09-10T09:23:16.106129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:09.909052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108510+0000","last_change":"2024-09-10T09:23:15.110923+0000","last_active":"2024-09-10T09:23:16.108510+0000","last_peered":"2024-09-10T09:23:16.108510+0000","last_clean":"2024-09-10T09:23:16.108510+0000","last_became_active":"2024-09-10T09:23:15.107021+0000","last_became_peered":"2024-09-10T09:23:15.107021+0000","last_unstale":"2024-09-10T09:23:16.108510+0000","last_undegraded":"2024-09-10T09:23:16.108510+0000","last_fullsized":"2024-09-10T09:23:16.108510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:03.906458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527509+0000","last_change":"2024-09-10T09:23:14.092345+0000","last_active":"2024-09-10T09:23:16.527509+0000","last_peered":"2024-09-10T09:23:16.527509+0000","last_clean":"2024-09-10T09:23:16.527509+0000","last_became_active":"2024-09-10T09:23:14.092049+0000","last_became_peered":"2024-09-10T09:23:14.092049+0000","last_unstale":"2024-09-10T09:23:16.527509+0000","last_undegraded":"2024-09-10T09:23:16.527509+0000","last_fullsized":"2024-09-10T09:23:16.527509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.792568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117182+0000","last_change":"2024-09-10T09:23:15.112860+0000","last_active":"2024-09-10T09:23:16.117182+0000","last_peered":"2024-09-10T09:23:16.117182+0000","last_clean":"2024-09-10T09:23:16.117182+0000","last_became_active":"2024-09-10T09:23:15.112603+0000","last_became_peered":"2024-09-10T09:23:15.112603+0000","last_unstale":"2024-09-10T09:23:16.117182+0000","last_undegraded":"2024-09-10T09:23:16.117182+0000","last_fullsized":"2024-09-10T09:23:16.117182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:00:01.440502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.123775+0000","last_change":"2024-09-10T09:23:14.093063+0000","last_active":"2024-09-10T09:23:15.123775+0000","last_peered":"2024-09-10T09:23:15.123775+0000","last_clean":"2024-09-10T09:23:15.123775+0000","last_became_active":"2024-09-10T09:23:14.092800+0000","last_became_peered":"2024-09-10T09:23:14.092800+0000","last_unstale":"2024-09-10T09:23:15.123775+0000","last_undegraded":"2024-09-10T09:23:15.123775+0000","last_fullsized":"2024-09-10T09:23:15.123775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:27.795911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040338+0000","last_change":"2024-09-10T09:23:15.113946+0000","last_active":"2024-09-10T09:23:17.040338+0000","last_peered":"2024-09-10T09:23:17.040338+0000","last_clean":"2024-09-10T09:23:17.040338+0000","last_became_active":"2024-09-10T09:23:15.113707+0000","last_became_peered":"2024-09-10T09:23:15.113707+0000","last_unstale":"2024-09-10T09:23:17.040338+0000","last_undegraded":"2024-09-10T09:23:17.040338+0000","last_fullsized":"2024-09-10T09:23:17.040338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:14.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108324+0000","last_change":"2024-09-10T09:23:14.090716+0000","last_active":"2024-09-10T09:23:16.108324+0000","last_peered":"2024-09-10T09:23:16.108324+0000","last_clean":"2024-09-10T09:23:16.108324+0000","last_became_active":"2024-09-10T09:23:14.090120+0000","last_became_peered":"2024-09-10T09:23:14.090120+0000","last_unstale":"2024-09-10T09:23:16.108324+0000","last_undegraded":"2024-09-10T09:23:16.108324+0000","last_fullsized":"2024-09-10T09:23:16.108324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:46.451689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107199+0000","last_change":"2024-09-10T09:23:15.105153+0000","last_active":"2024-09-10T09:23:16.107199+0000","last_peered":"2024-09-10T09:23:16.107199+0000","last_clean":"2024-09-10T09:23:16.107199+0000","last_became_active":"2024-09-10T09:23:15.104896+0000","last_became_peered":"2024-09-10T09:23:15.104896+0000","last_unstale":"2024-09-10T09:23:16.107199+0000","last_undegraded":"2024-09-10T09:23:16.107199+0000","last_fullsized":"2024-09-10T09:23:16.107199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:45.986519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108748+0000","last_change":"2024-09-10T09:23:14.090542+0000","last_active":"2024-09-10T09:23:16.108748+0000","last_peered":"2024-09-10T09:23:16.108748+0000","last_clean":"2024-09-10T09:23:16.108748+0000","last_became_active":"2024-09-10T09:23:14.090273+0000","last_became_peered":"2024-09-10T09:23:14.090273+0000","last_unstale":"2024-09-10T09:23:16.108748+0000","last_undegraded":"2024-09-10T09:23:16.108748+0000","last_fullsized":"2024-09-10T09:23:16.108748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.368076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108136+0000","last_change":"2024-09-10T09:23:15.110471+0000","last_active":"2024-09-10T09:23:16.108136+0000","last_peered":"2024-09-10T09:23:16.108136+0000","last_clean":"2024-09-10T09:23:16.108136+0000","last_became_active":"2024-09-10T09:23:15.110148+0000","last_became_peered":"2024-09-10T09:23:15.110148+0000","last_unstale":"2024-09-10T09:23:16.108136+0000","last_undegraded":"2024-09-10T09:23:16.108136+0000","last_fullsized":"2024-09-10T09:23:16.108136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:52.417628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527388+0000","last_change":"2024-09-10T09:23:14.094441+0000","last_active":"2024-09-10T09:23:16.527388+0000","last_peered":"2024-09-10T09:23:16.527388+0000","last_clean":"2024-09-10T09:23:16.527388+0000","last_became_active":"2024-09-10T09:23:14.094161+0000","last_became_peered":"2024-09-10T09:23:14.094161+0000","last_unstale":"2024-09-10T09:23:16.527388+0000","last_undegraded":"2024-09-10T09:23:16.527388+0000","last_fullsized":"2024-09-10T09:23:16.527388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:31.353371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116576+0000","last_change":"2024-09-10T09:23:15.102590+0000","last_active":"2024-09-10T09:23:16.116576+0000","last_peered":"2024-09-10T09:23:16.116576+0000","last_clean":"2024-09-10T09:23:16.116576+0000","last_became_active":"2024-09-10T09:23:15.102322+0000","last_became_peered":"2024-09-10T09:23:15.102322+0000","last_unstale":"2024-09-10T09:23:16.116576+0000","last_undegraded":"2024-09-10T09:23:16.116576+0000","last_fullsized":"2024-09-10T09:23:16.116576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:54.342264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108023+0000","last_change":"2024-09-10T09:23:14.088326+0000","last_active":"2024-09-10T09:23:16.108023+0000","last_peered":"2024-09-10T09:23:16.108023+0000","last_clean":"2024-09-10T09:23:16.108023+0000","last_became_active":"2024-09-10T09:23:14.088041+0000","last_became_peered":"2024-09-10T09:23:14.088041+0000","last_unstale":"2024-09-10T09:23:16.108023+0000","last_undegraded":"2024-09-10T09:23:16.108023+0000","last_fullsized":"2024-09-10T09:23:16.108023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:57.508460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107380+0000","last_change":"2024-09-10T09:23:15.102541+0000","last_active":"2024-09-10T09:23:16.107380+0000","last_peered":"2024-09-10T09:23:16.107380+0000","last_clean":"2024-09-10T09:23:16.107380+0000","last_became_active":"2024-09-10T09:23:15.102278+0000","last_became_peered":"2024-09-10T09:23:15.102278+0000","last_unstale":"2024-09-10T09:23:16.107380+0000","last_undegraded":"2024-09-10T09:23:16.107380+0000","last_fullsized":"2024-09-10T09:23:16.107380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:01.134511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527786+0000","last_change":"2024-09-10T09:23:14.088188+0000","last_active":"2024-09-10T09:23:16.527786+0000","last_peered":"2024-09-10T09:23:16.527786+0000","last_clean":"2024-09-10T09:23:16.527786+0000","last_became_active":"2024-09-10T09:23:14.087874+0000","last_became_peered":"2024-09-10T09:23:14.087874+0000","last_unstale":"2024-09-10T09:23:16.527786+0000","last_undegraded":"2024-09-10T09:23:16.527786+0000","last_fullsized":"2024-09-10T09:23:16.527786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:32.625742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527737+0000","last_change":"2024-09-10T09:23:15.112119+0000","last_active":"2024-09-10T09:23:16.527737+0000","last_peered":"2024-09-10T09:23:16.527737+0000","last_clean":"2024-09-10T09:23:16.527737+0000","last_became_active":"2024-09-10T09:23:15.111784+0000","last_became_peered":"2024-09-10T09:23:15.111784+0000","last_unstale":"2024-09-10T09:23:16.527737+0000","last_undegraded":"2024-09-10T09:23:16.527737+0000","last_fullsized":"2024-09-10T09:23:16.527737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:17.642071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106223+0000","last_change":"2024-09-10T09:23:14.093608+0000","last_active":"2024-09-10T09:23:16.106223+0000","last_peered":"2024-09-10T09:23:16.106223+0000","last_clean":"2024-09-10T09:23:16.106223+0000","last_became_active":"2024-09-10T09:23:14.092903+0000","last_became_peered":"2024-09-10T09:23:14.092903+0000","last_unstale":"2024-09-10T09:23:16.106223+0000","last_undegraded":"2024-09-10T09:23:16.106223+0000","last_fullsized":"2024-09-10T09:23:16.106223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:31.617271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527627+0000","last_change":"2024-09-10T09:23:15.104971+0000","last_active":"2024-09-10T09:23:16.527627+0000","last_peered":"2024-09-10T09:23:16.527627+0000","last_clean":"2024-09-10T09:23:16.527627+0000","last_became_active":"2024-09-10T09:23:15.104617+0000","last_became_peered":"2024-09-10T09:23:15.104617+0000","last_unstale":"2024-09-10T09:23:16.527627+0000","last_undegraded":"2024-09-10T09:23:16.527627+0000","last_fullsized":"2024-09-10T09:23:16.527627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:39.615093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107466+0000","last_change":"2024-09-10T09:23:14.087172+0000","last_active":"2024-09-10T09:23:16.107466+0000","last_peered":"2024-09-10T09:23:16.107466+0000","last_clean":"2024-09-10T09:23:16.107466+0000","last_became_active":"2024-09-10T09:23:14.086892+0000","last_became_peered":"2024-09-10T09:23:14.086892+0000","last_unstale":"2024-09-10T09:23:16.107466+0000","last_undegraded":"2024-09-10T09:23:16.107466+0000","last_fullsized":"2024-09-10T09:23:16.107466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:06.830381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107242+0000","last_change":"2024-09-10T09:23:15.113651+0000","last_active":"2024-09-10T09:23:16.107242+0000","last_peered":"2024-09-10T09:23:16.107242+0000","last_clean":"2024-09-10T09:23:16.107242+0000","last_became_active":"2024-09-10T09:23:15.113397+0000","last_became_peered":"2024-09-10T09:23:15.113397+0000","last_unstale":"2024-09-10T09:23:16.107242+0000","last_undegraded":"2024-09-10T09:23:16.107242+0000","last_fullsized":"2024-09-10T09:23:16.107242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:14.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527686+0000","last_change":"2024-09-10T09:23:14.093220+0000","last_active":"2024-09-10T09:23:16.527686+0000","last_peered":"2024-09-10T09:23:16.527686+0000","last_clean":"2024-09-10T09:23:16.527686+0000","last_became_active":"2024-09-10T09:23:14.092931+0000","last_became_peered":"2024-09-10T09:23:14.092931+0000","last_unstale":"2024-09-10T09:23:16.527686+0000","last_undegraded":"2024-09-10T09:23:16.527686+0000","last_fullsized":"2024-09-10T09:23:16.527686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:51.789313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116586+0000","last_change":"2024-09-10T09:23:15.108984+0000","last_active":"2024-09-10T09:23:16.116586+0000","last_peered":"2024-09-10T09:23:16.116586+0000","last_clean":"2024-09-10T09:23:16.116586+0000","last_became_active":"2024-09-10T09:23:15.108688+0000","last_became_peered":"2024-09-10T09:23:15.108688+0000","last_unstale":"2024-09-10T09:23:16.116586+0000","last_undegraded":"2024-09-10T09:23:16.116586+0000","last_fullsized":"2024-09-10T09:23:16.116586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:38:29.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108492+0000","last_change":"2024-09-10T09:23:14.087763+0000","last_active":"2024-09-10T09:23:16.108492+0000","last_peered":"2024-09-10T09:23:16.108492+0000","last_clean":"2024-09-10T09:23:16.108492+0000","last_became_active":"2024-09-10T09:23:14.087499+0000","last_became_peered":"2024-09-10T09:23:14.087499+0000","last_unstale":"2024-09-10T09:23:16.108492+0000","last_undegraded":"2024-09-10T09:23:16.108492+0000","last_fullsized":"2024-09-10T09:23:16.108492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:23.272366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527641+0000","last_change":"2024-09-10T09:23:15.101478+0000","last_active":"2024-09-10T09:23:16.527641+0000","last_peered":"2024-09-10T09:23:16.527641+0000","last_clean":"2024-09-10T09:23:16.527641+0000","last_became_active":"2024-09-10T09:23:15.101193+0000","last_became_peered":"2024-09-10T09:23:15.101193+0000","last_unstale":"2024-09-10T09:23:16.527641+0000","last_undegraded":"2024-09-10T09:23:16.527641+0000","last_fullsized":"2024-09-10T09:23:16.527641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:30.405421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116607+0000","last_change":"2024-09-10T09:23:14.086819+0000","last_active":"2024-09-10T09:23:16.116607+0000","last_peered":"2024-09-10T09:23:16.116607+0000","last_clean":"2024-09-10T09:23:16.116607+0000","last_became_active":"2024-09-10T09:23:14.086492+0000","last_became_peered":"2024-09-10T09:23:14.086492+0000","last_unstale":"2024-09-10T09:23:16.116607+0000","last_undegraded":"2024-09-10T09:23:16.116607+0000","last_fullsized":"2024-09-10T09:23:16.116607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:55.544022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040523+0000","last_change":"2024-09-10T09:23:15.114637+0000","last_active":"2024-09-10T09:23:17.040523+0000","last_peered":"2024-09-10T09:23:17.040523+0000","last_clean":"2024-09-10T09:23:17.040523+0000","last_became_active":"2024-09-10T09:23:15.114335+0000","last_became_peered":"2024-09-10T09:23:15.114335+0000","last_unstale":"2024-09-10T09:23:17.040523+0000","last_undegraded":"2024-09-10T09:23:17.040523+0000","last_fullsized":"2024-09-10T09:23:17.040523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:47.787487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527309+0000","last_change":"2024-09-10T09:23:14.086789+0000","last_active":"2024-09-10T09:23:16.527309+0000","last_peered":"2024-09-10T09:23:16.527309+0000","last_clean":"2024-09-10T09:23:16.527309+0000","last_became_active":"2024-09-10T09:23:14.086491+0000","last_became_peered":"2024-09-10T09:23:14.086491+0000","last_unstale":"2024-09-10T09:23:16.527309+0000","last_undegraded":"2024-09-10T09:23:16.527309+0000","last_fullsized":"2024-09-10T09:23:16.527309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:27.131435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071439+0000","last_change":"2024-09-10T09:23:15.112018+0000","last_active":"2024-09-10T09:23:17.071439+0000","last_peered":"2024-09-10T09:23:17.071439+0000","last_clean":"2024-09-10T09:23:17.071439+0000","last_became_active":"2024-09-10T09:23:15.111767+0000","last_became_peered":"2024-09-10T09:23:15.111767+0000","last_unstale":"2024-09-10T09:23:17.071439+0000","last_undegraded":"2024-09-10T09:23:17.071439+0000","last_fullsized":"2024-09-10T09:23:17.071439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:35.766176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527557+0000","last_change":"2024-09-10T09:23:14.095637+0000","last_active":"2024-09-10T09:23:16.527557+0000","last_peered":"2024-09-10T09:23:16.527557+0000","last_clean":"2024-09-10T09:23:16.527557+0000","last_became_active":"2024-09-10T09:23:14.095310+0000","last_became_peered":"2024-09-10T09:23:14.095310+0000","last_unstale":"2024-09-10T09:23:16.527557+0000","last_undegraded":"2024-09-10T09:23:16.527557+0000","last_fullsized":"2024-09-10T09:23:16.527557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:51.415267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108449+0000","last_change":"2024-09-10T09:23:15.111375+0000","last_active":"2024-09-10T09:23:16.108449+0000","last_peered":"2024-09-10T09:23:16.108449+0000","last_clean":"2024-09-10T09:23:16.108449+0000","last_became_active":"2024-09-10T09:23:15.107896+0000","last_became_peered":"2024-09-10T09:23:15.107896+0000","last_unstale":"2024-09-10T09:23:16.108449+0000","last_undegraded":"2024-09-10T09:23:16.108449+0000","last_fullsized":"2024-09-10T09:23:16.108449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:52.791674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117062+0000","last_change":"2024-09-10T09:23:14.097464+0000","last_active":"2024-09-10T09:23:16.117062+0000","last_peered":"2024-09-10T09:23:16.117062+0000","last_clean":"2024-09-10T09:23:16.117062+0000","last_became_active":"2024-09-10T09:23:14.097145+0000","last_became_peered":"2024-09-10T09:23:14.097145+0000","last_unstale":"2024-09-10T09:23:16.117062+0000","last_undegraded":"2024-09-10T09:23:16.117062+0000","last_fullsized":"2024-09-10T09:23:16.117062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:51.497947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107649+0000","last_change":"2024-09-10T09:23:15.107831+0000","last_active":"2024-09-10T09:23:16.107649+0000","last_peered":"2024-09-10T09:23:16.107649+0000","last_clean":"2024-09-10T09:23:16.107649+0000","last_became_active":"2024-09-10T09:23:15.107580+0000","last_became_peered":"2024-09-10T09:23:15.107580+0000","last_unstale":"2024-09-10T09:23:16.107649+0000","last_undegraded":"2024-09-10T09:23:16.107649+0000","last_fullsized":"2024-09-10T09:23:16.107649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:35.730918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108515+0000","last_change":"2024-09-10T09:23:14.088057+0000","last_active":"2024-09-10T09:23:16.108515+0000","last_peered":"2024-09-10T09:23:16.108515+0000","last_clean":"2024-09-10T09:23:16.108515+0000","last_became_active":"2024-09-10T09:23:14.087506+0000","last_became_peered":"2024-09-10T09:23:14.087506+0000","last_unstale":"2024-09-10T09:23:16.108515+0000","last_undegraded":"2024-09-10T09:23:16.108515+0000","last_fullsized":"2024-09-10T09:23:16.108515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:08.645216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116831+0000","last_change":"2024-09-10T09:23:15.114857+0000","last_active":"2024-09-10T09:23:16.116831+0000","last_peered":"2024-09-10T09:23:16.116831+0000","last_clean":"2024-09-10T09:23:16.116831+0000","last_became_active":"2024-09-10T09:23:15.113307+0000","last_became_peered":"2024-09-10T09:23:15.113307+0000","last_unstale":"2024-09-10T09:23:16.116831+0000","last_undegraded":"2024-09-10T09:23:16.116831+0000","last_fullsized":"2024-09-10T09:23:16.116831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.794887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108465+0000","last_change":"2024-09-10T09:23:14.079258+0000","last_active":"2024-09-10T09:23:16.108465+0000","last_peered":"2024-09-10T09:23:16.108465+0000","last_clean":"2024-09-10T09:23:16.108465+0000","last_became_active":"2024-09-10T09:23:14.078798+0000","last_became_peered":"2024-09-10T09:23:14.078798+0000","last_unstale":"2024-09-10T09:23:16.108465+0000","last_undegraded":"2024-09-10T09:23:16.108465+0000","last_fullsized":"2024-09-10T09:23:16.108465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:28.039387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120489+0000","last_change":"2024-09-10T09:23:15.110219+0000","last_active":"2024-09-10T09:23:15.120489+0000","last_peered":"2024-09-10T09:23:15.120489+0000","last_clean":"2024-09-10T09:23:15.120489+0000","last_became_active":"2024-09-10T09:23:15.109885+0000","last_became_peered":"2024-09-10T09:23:15.109885+0000","last_unstale":"2024-09-10T09:23:15.120489+0000","last_undegraded":"2024-09-10T09:23:15.120489+0000","last_fullsized":"2024-09-10T09:23:15.120489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:49.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108620+0000","last_change":"2024-09-10T09:23:14.087164+0000","last_active":"2024-09-10T09:23:16.108620+0000","last_peered":"2024-09-10T09:23:16.108620+0000","last_clean":"2024-09-10T09:23:16.108620+0000","last_became_active":"2024-09-10T09:23:14.086912+0000","last_became_peered":"2024-09-10T09:23:14.086912+0000","last_unstale":"2024-09-10T09:23:16.108620+0000","last_undegraded":"2024-09-10T09:23:16.108620+0000","last_fullsized":"2024-09-10T09:23:16.108620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:37.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.120805+0000","last_change":"2024-09-10T09:23:15.113221+0000","last_active":"2024-09-10T09:23:15.120805+0000","last_peered":"2024-09-10T09:23:15.120805+0000","last_clean":"2024-09-10T09:23:15.120805+0000","last_became_active":"2024-09-10T09:23:15.112926+0000","last_became_peered":"2024-09-10T09:23:15.112926+0000","last_unstale":"2024-09-10T09:23:15.120805+0000","last_undegraded":"2024-09-10T09:23:15.120805+0000","last_fullsized":"2024-09-10T09:23:15.120805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:44.304719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106202+0000","last_change":"2024-09-10T09:23:14.094864+0000","last_active":"2024-09-10T09:23:16.106202+0000","last_peered":"2024-09-10T09:23:16.106202+0000","last_clean":"2024-09-10T09:23:16.106202+0000","last_became_active":"2024-09-10T09:23:14.094568+0000","last_became_peered":"2024-09-10T09:23:14.094568+0000","last_unstale":"2024-09-10T09:23:16.106202+0000","last_undegraded":"2024-09-10T09:23:16.106202+0000","last_fullsized":"2024-09-10T09:23:16.106202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:22.619886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.109418+0000","last_change":"2024-09-10T09:23:15.104419+0000","last_active":"2024-09-10T09:23:15.109418+0000","last_peered":"2024-09-10T09:23:15.109418+0000","last_clean":"2024-09-10T09:23:15.109418+0000","last_became_active":"2024-09-10T09:23:15.104118+0000","last_became_peered":"2024-09-10T09:23:15.104118+0000","last_unstale":"2024-09-10T09:23:15.109418+0000","last_undegraded":"2024-09-10T09:23:15.109418+0000","last_fullsized":"2024-09-10T09:23:15.109418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:45.414616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071280+0000","last_change":"2024-09-10T09:23:14.093049+0000","last_active":"2024-09-10T09:23:17.071280+0000","last_peered":"2024-09-10T09:23:17.071280+0000","last_clean":"2024-09-10T09:23:17.071280+0000","last_became_active":"2024-09-10T09:23:14.092775+0000","last_became_peered":"2024-09-10T09:23:14.092775+0000","last_unstale":"2024-09-10T09:23:17.071280+0000","last_undegraded":"2024-09-10T09:23:17.071280+0000","last_fullsized":"2024-09-10T09:23:17.071280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:09.909052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.115062+0000","last_change":"2024-09-10T09:23:15.107859+0000","last_active":"2024-09-10T09:23:15.115062+0000","last_peered":"2024-09-10T09:23:15.115062+0000","last_clean":"2024-09-10T09:23:15.115062+0000","last_became_active":"2024-09-10T09:23:15.107225+0000","last_became_peered":"2024-09-10T09:23:15.107225+0000","last_unstale":"2024-09-10T09:23:15.115062+0000","last_undegraded":"2024-09-10T09:23:15.115062+0000","last_fullsized":"2024-09-10T09:23:15.115062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:02.879398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108104+0000","last_change":"2024-09-10T09:23:14.086690+0000","last_active":"2024-09-10T09:23:16.108104+0000","last_peered":"2024-09-10T09:23:16.108104+0000","last_clean":"2024-09-10T09:23:16.108104+0000","last_became_active":"2024-09-10T09:23:14.086422+0000","last_became_peered":"2024-09-10T09:23:14.086422+0000","last_unstale":"2024-09-10T09:23:16.108104+0000","last_undegraded":"2024-09-10T09:23:16.108104+0000","last_fullsized":"2024-09-10T09:23:16.108104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:15.464088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040365+0000","last_change":"2024-09-10T09:23:15.108731+0000","last_active":"2024-09-10T09:23:17.040365+0000","last_peered":"2024-09-10T09:23:17.040365+0000","last_clean":"2024-09-10T09:23:17.040365+0000","last_became_active":"2024-09-10T09:23:15.108454+0000","last_became_peered":"2024-09-10T09:23:15.108454+0000","last_unstale":"2024-09-10T09:23:17.040365+0000","last_undegraded":"2024-09-10T09:23:17.040365+0000","last_fullsized":"2024-09-10T09:23:17.040365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:57.258464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106958+0000","last_change":"2024-09-10T09:23:14.083386+0000","last_active":"2024-09-10T09:23:16.106958+0000","last_peered":"2024-09-10T09:23:16.106958+0000","last_clean":"2024-09-10T09:23:16.106958+0000","last_became_active":"2024-09-10T09:23:14.083122+0000","last_became_peered":"2024-09-10T09:23:14.083122+0000","last_unstale":"2024-09-10T09:23:16.106958+0000","last_undegraded":"2024-09-10T09:23:16.106958+0000","last_fullsized":"2024-09-10T09:23:16.106958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:39.168289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T09:23:15.109485+0000","last_change":"2024-09-10T09:23:15.104173+0000","last_active":"2024-09-10T09:23:15.109485+0000","last_peered":"2024-09-10T09:23:15.109485+0000","last_clean":"2024-09-10T09:23:15.109485+0000","last_became_active":"2024-09-10T09:23:15.103881+0000","last_became_peered":"2024-09-10T09:23:15.103881+0000","last_unstale":"2024-09-10T09:23:15.109485+0000","last_undegraded":"2024-09-10T09:23:15.109485+0000","last_fullsized":"2024-09-10T09:23:15.109485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:07.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.117137+0000","last_change":"2024-09-10T09:23:14.093161+0000","last_active":"2024-09-10T09:23:16.117137+0000","last_peered":"2024-09-10T09:23:16.117137+0000","last_clean":"2024-09-10T09:23:16.117137+0000","last_became_active":"2024-09-10T09:23:14.092626+0000","last_became_peered":"2024-09-10T09:23:14.092626+0000","last_unstale":"2024-09-10T09:23:16.117137+0000","last_undegraded":"2024-09-10T09:23:16.117137+0000","last_fullsized":"2024-09-10T09:23:16.117137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:48.558743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.107722+0000","last_change":"2024-09-10T09:23:15.113575+0000","last_active":"2024-09-10T09:23:16.107722+0000","last_peered":"2024-09-10T09:23:16.107722+0000","last_clean":"2024-09-10T09:23:16.107722+0000","last_became_active":"2024-09-10T09:23:15.113295+0000","last_became_peered":"2024-09-10T09:23:15.113295+0000","last_unstale":"2024-09-10T09:23:16.107722+0000","last_undegraded":"2024-09-10T09:23:16.107722+0000","last_fullsized":"2024-09-10T09:23:16.107722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:43.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.113964+0000","last_change":"2024-09-10T09:23:14.093884+0000","last_active":"2024-09-10T09:23:16.113964+0000","last_peered":"2024-09-10T09:23:16.113964+0000","last_clean":"2024-09-10T09:23:16.113964+0000","last_became_active":"2024-09-10T09:23:14.093340+0000","last_became_peered":"2024-09-10T09:23:14.093340+0000","last_unstale":"2024-09-10T09:23:16.113964+0000","last_undegraded":"2024-09-10T09:23:16.113964+0000","last_fullsized":"2024-09-10T09:23:16.113964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:39.168289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106116+0000","last_change":"2024-09-10T09:23:15.107911+0000","last_active":"2024-09-10T09:23:16.106116+0000","last_peered":"2024-09-10T09:23:16.106116+0000","last_clean":"2024-09-10T09:23:16.106116+0000","last_became_active":"2024-09-10T09:23:15.107577+0000","last_became_peered":"2024-09-10T09:23:15.107577+0000","last_unstale":"2024-09-10T09:23:16.106116+0000","last_undegraded":"2024-09-10T09:23:16.106116+0000","last_fullsized":"2024-09-10T09:23:16.106116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:02.585818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116928+0000","last_change":"2024-09-10T09:23:14.092986+0000","last_active":"2024-09-10T09:23:16.116928+0000","last_peered":"2024-09-10T09:23:16.116928+0000","last_clean":"2024-09-10T09:23:16.116928+0000","last_became_active":"2024-09-10T09:23:14.092734+0000","last_became_peered":"2024-09-10T09:23:14.092734+0000","last_unstale":"2024-09-10T09:23:16.116928+0000","last_undegraded":"2024-09-10T09:23:16.116928+0000","last_fullsized":"2024-09-10T09:23:16.116928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:32.932117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071308+0000","last_change":"2024-09-10T09:23:15.101712+0000","last_active":"2024-09-10T09:23:17.071308+0000","last_peered":"2024-09-10T09:23:17.071308+0000","last_clean":"2024-09-10T09:23:17.071308+0000","last_became_active":"2024-09-10T09:23:15.101472+0000","last_became_peered":"2024-09-10T09:23:15.101472+0000","last_unstale":"2024-09-10T09:23:17.071308+0000","last_undegraded":"2024-09-10T09:23:17.071308+0000","last_fullsized":"2024-09-10T09:23:17.071308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:09.216437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106324+0000","last_change":"2024-09-10T09:23:14.086050+0000","last_active":"2024-09-10T09:23:16.106324+0000","last_peered":"2024-09-10T09:23:16.106324+0000","last_clean":"2024-09-10T09:23:16.106324+0000","last_became_active":"2024-09-10T09:23:14.085616+0000","last_became_peered":"2024-09-10T09:23:14.085616+0000","last_unstale":"2024-09-10T09:23:16.106324+0000","last_undegraded":"2024-09-10T09:23:16.106324+0000","last_fullsized":"2024-09-10T09:23:16.106324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:02.526532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.106247+0000","last_change":"2024-09-10T09:23:15.110006+0000","last_active":"2024-09-10T09:23:16.106247+0000","last_peered":"2024-09-10T09:23:16.106247+0000","last_clean":"2024-09-10T09:23:16.106247+0000","last_became_active":"2024-09-10T09:23:15.109700+0000","last_became_peered":"2024-09-10T09:23:15.109700+0000","last_unstale":"2024-09-10T09:23:16.106247+0000","last_undegraded":"2024-09-10T09:23:16.106247+0000","last_fullsized":"2024-09-10T09:23:16.106247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.436638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.116682+0000","last_change":"2024-09-10T09:23:14.092726+0000","last_active":"2024-09-10T09:23:16.116682+0000","last_peered":"2024-09-10T09:23:16.116682+0000","last_clean":"2024-09-10T09:23:16.116682+0000","last_became_active":"2024-09-10T09:23:14.092425+0000","last_became_peered":"2024-09-10T09:23:14.092425+0000","last_unstale":"2024-09-10T09:23:16.116682+0000","last_undegraded":"2024-09-10T09:23:16.116682+0000","last_fullsized":"2024-09-10T09:23:16.116682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:27.131435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527332+0000","last_change":"2024-09-10T09:23:15.110209+0000","last_active":"2024-09-10T09:23:16.527332+0000","last_peered":"2024-09-10T09:23:16.527332+0000","last_clean":"2024-09-10T09:23:16.527332+0000","last_became_active":"2024-09-10T09:23:15.109868+0000","last_became_peered":"2024-09-10T09:23:15.109868+0000","last_unstale":"2024-09-10T09:23:16.527332+0000","last_undegraded":"2024-09-10T09:23:16.527332+0000","last_fullsized":"2024-09-10T09:23:16.527332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:15.208451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108186+0000","last_change":"2024-09-10T09:23:14.085099+0000","last_active":"2024-09-10T09:23:16.108186+0000","last_peered":"2024-09-10T09:23:16.108186+0000","last_clean":"2024-09-10T09:23:16.108186+0000","last_became_active":"2024-09-10T09:23:14.084828+0000","last_became_peered":"2024-09-10T09:23:14.084828+0000","last_unstale":"2024-09-10T09:23:16.108186+0000","last_undegraded":"2024-09-10T09:23:16.108186+0000","last_fullsized":"2024-09-10T09:23:16.108186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:51.177494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.108077+0000","last_change":"2024-09-10T09:23:15.111648+0000","last_active":"2024-09-10T09:23:16.108077+0000","last_peered":"2024-09-10T09:23:16.108077+0000","last_clean":"2024-09-10T09:23:16.108077+0000","last_became_active":"2024-09-10T09:23:15.111331+0000","last_became_peered":"2024-09-10T09:23:15.111331+0000","last_unstale":"2024-09-10T09:23:16.108077+0000","last_undegraded":"2024-09-10T09:23:16.108077+0000","last_fullsized":"2024-09-10T09:23:16.108077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.098727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:16.527362+0000","last_change":"2024-09-10T09:23:14.089474+0000","last_active":"2024-09-10T09:23:16.527362+0000","last_peered":"2024-09-10T09:23:16.527362+0000","last_clean":"2024-09-10T09:23:16.527362+0000","last_became_active":"2024-09-10T09:23:14.089168+0000","last_became_peered":"2024-09-10T09:23:14.089168+0000","last_unstale":"2024-09-10T09:23:16.527362+0000","last_undegraded":"2024-09-10T09:23:16.527362+0000","last_fullsized":"2024-09-10T09:23:16.527362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:42.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040524+0000","last_change":"2024-09-10T09:23:15.107175+0000","last_active":"2024-09-10T09:23:17.040524+0000","last_peered":"2024-09-10T09:23:17.040524+0000","last_clean":"2024-09-10T09:23:17.040524+0000","last_became_active":"2024-09-10T09:23:15.106920+0000","last_became_peered":"2024-09-10T09:23:15.106920+0000","last_unstale":"2024-09-10T09:23:17.040524+0000","last_undegraded":"2024-09-10T09:23:17.040524+0000","last_fullsized":"2024-09-10T09:23:17.040524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:14.068354+0000","last_clean_scrub_stamp":"2024-09-10T09:23:14.068354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:01.134511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.071363+0000","last_change":"2024-09-10T09:23:14.090158+0000","last_active":"2024-09-10T09:23:17.071363+0000","last_peered":"2024-09-10T09:23:17.071363+0000","last_clean":"2024-09-10T09:23:17.071363+0000","last_became_active":"2024-09-10T09:23:14.089870+0000","last_became_peered":"2024-09-10T09:23:14.089870+0000","last_unstale":"2024-09-10T09:23:17.071363+0000","last_undegraded":"2024-09-10T09:23:17.071363+0000","last_fullsized":"2024-09-10T09:23:17.071363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:23:13.065993+0000","last_clean_scrub_stamp":"2024-09-10T09:23:13.065993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:19.466783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T09:23:17.040016+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:17.040016+0000","last_peered":"2024-09-10T09:23:17.040016+0000","last_clean":"2024-09-10T09:23:17.040016+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:17.040016+0000","last_undegraded":"2024-09-10T09:23:17.040016+0000","last_fullsized":"2024-09-10T09:23:17.040016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":942080,"data_stored":721439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":137897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":137953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":137385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":131051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":727649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:22.852 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T09:23:22.852 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T09:23:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.994+0000 7fc02bd42640 1 Processor -- start 2024-09-10T09:23:22.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.994+0000 7fc02bd42640 1 -- start start 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc02bd42640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc02bd42640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0241633f0 con 0x7fc0240b3b00 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc02bd42640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0240b6b00 con 0x7fc0240d3990 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc02bd42640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc0240d24f0 con 0x7fc0240b61e0 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc0292dd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc0240b3b00 0x7fc0241625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46714/0 (socket says 172.21.15.12:46714) 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc0292dd640 1 -- 172.21.15.12:0/859788955 learned_addr learned my addr 172.21.15.12:0/859788955 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:22.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.995+0000 7fc029ade640 1 --2- 172.21.15.12:0/859788955 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.996+0000 7fc028adc640 1 -- 172.21.15.12:0/859788955 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586865587 0 0) 0x7fc0241633f0 con 0x7fc0240b3b00 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.996+0000 7fc028adc640 1 -- 172.21.15.12:0/859788955 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc00c003520 con 0x7fc0240b3b00 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.996+0000 7fc028adc640 1 -- 172.21.15.12:0/859788955 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122358664 0 0) 0x7fc0240b6b00 con 0x7fc0240d3990 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.996+0000 7fc029ade640 1 -- 172.21.15.12:0/859788955 >> v1:172.21.15.100:6789/0 conn(0x7fc0240d3990 legacy=0x7fc024162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.996+0000 7fc029ade640 1 -- 172.21.15.12:0/859788955 >> v1:172.21.15.12:6789/0 conn(0x7fc0240b3b00 legacy=0x7fc0241625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.996+0000 7fc029ade640 1 -- 172.21.15.12:0/859788955 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0240d20e0 con 0x7fc0240b61e0 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc029ade640 1 --2- 172.21.15.12:0/859788955 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240b65c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc014009dc0 tx=0x7fc01402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4589b57593686 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:22.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc028adc640 1 -- 172.21.15.12:0/859788955 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014007740 con 0x7fc0240b61e0 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc028adc640 1 -- 172.21.15.12:0/859788955 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0140078e0 con 0x7fc0240b61e0 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc028adc640 1 -- 172.21.15.12:0/859788955 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014007cb0 con 0x7fc0240b61e0 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 -- 172.21.15.12:0/859788955 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 msgr2=0x7fc0240b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 --2- 172.21.15.12:0/859788955 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240b65c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc014009dc0 tx=0x7fc01402a5b0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 -- 172.21.15.12:0/859788955 shutdown_connections 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 --2- 172.21.15.12:0/859788955 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240b65c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 -- 172.21.15.12:0/859788955 >> 172.21.15.12:0/859788955 conn(0x7fc0240d11e0 msgr2=0x7fc0240d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 -- 172.21.15.12:0/859788955 shutdown_connections 2024-09-10T09:23:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.997+0000 7fc02bd42640 1 -- 172.21.15.12:0/859788955 wait complete. 2024-09-10T09:23:23.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 Processor -- start 2024-09-10T09:23:23.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 -- start start 2024-09-10T09:23:23.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 0x7fc024152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0240d3990 0x7fc0240ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240d0030 con 0x7fc0240b3b00 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0240cfd50 con 0x7fc0240d3990 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc02bd42640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc02415edc0 con 0x7fc0240b61e0 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc029ade640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 0x7fc024152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:22.999+0000 7fc029ade640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 0x7fc024152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33268/0 (socket says 172.21.15.12:33268) 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 -- 172.21.15.12:0/2126067959 learned_addr learned my addr 172.21.15.12:0/2126067959 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc0292dd640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc02a2df640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0240d3990 0x7fc0240ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 -- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 msgr2=0x7fc0240ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 -- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0240d3990 msgr2=0x7fc0240ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0240d3990 0x7fc0240ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 -- 172.21.15.12:0/2126067959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0240cbb80 con 0x7fc0240b3b00 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc0292dd640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:23.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc02a2df640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0240d3990 0x7fc0240ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:23.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc029ade640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 0x7fc024152b70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc014009ee0 tx=0x7fc014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:23.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01403f070 con 0x7fc0240b3b00 2024-09-10T09:23:23.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014031c40 con 0x7fc0240b3b00 2024-09-10T09:23:23.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0240cbe60 con 0x7fc0240b3b00 2024-09-10T09:23:23.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014009450 con 0x7fc0240b3b00 2024-09-10T09:23:23.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.000+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0240cc420 con 0x7fc0240b3b00 2024-09-10T09:23:23.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.001+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0240d1d00 con 0x7fc0240b3b00 2024-09-10T09:23:23.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.002+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc014043410 con 0x7fc0240b3b00 2024-09-10T09:23:23.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.002+0000 7fc0227fc640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc01006be30 0x7fc01006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.002+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc0140ac2f0 con 0x7fc0240b3b00 2024-09-10T09:23:23.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.002+0000 7fc0292dd640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc01006be30 0x7fc01006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.003+0000 7fc0292dd640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc01006be30 0x7fc01006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0240cdb60 tx=0x7fc018009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:23.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.006+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc01404b350 con 0x7fc0240b3b00 2024-09-10T09:23:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.256+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc0240ba6e0 con 0x7fc0240b3b00 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.258+0000 7fc0227fc640 1 -- 172.21.15.12:0/2126067959 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7fc01407ac20 con 0x7fc0240b3b00 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgD+BmiuoDIBAAv4A7F5XnNMKzCjr+tB2NaA== 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: caps mds = "allow" 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: caps mon = "allow r" 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T09:23:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc01006be30 msgr2=0x7fc01006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc01006be30 0x7fc01006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0240cdb60 tx=0x7fc018009040 comp rx=0 tx=0).stop 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 msgr2=0x7fc024152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 0x7fc024152b70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc014009ee0 tx=0x7fc014004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 shutdown_connections 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fc01006be30 0x7fc01006e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0240d3990 0x7fc0240ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc0240b61e0 0x7fc0240ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 --2- 172.21.15.12:0/2126067959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0240b3b00 0x7fc024152b70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 >> 172.21.15.12:0/2126067959 conn(0x7fc0240d11e0 msgr2=0x7fc02415d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 shutdown_connections 2024-09-10T09:23:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.261+0000 7fc02bd42640 1 -- 172.21.15.12:0/2126067959 wait complete. 2024-09-10T09:23:23.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:23.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.375+0000 7f0e1db2a640 1 Processor -- start 2024-09-10T09:23:23.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.375+0000 7f0e1db2a640 1 -- start start 2024-09-10T09:23:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e1db2a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e1806ccb0 0x7f0e1806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e1db2a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e180741c0 con 0x7f0e1815e7b0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e1db2a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1806e8d0 con 0x7f0e180b5600 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e1db2a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1806e680 con 0x7f0e1806ccb0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e17fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e1806ccb0 0x7f0e1806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e17fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e1806ccb0 0x7f0e1806d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33276/0 (socket says 172.21.15.12:33276) 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e17fff640 1 -- 172.21.15.12:0/2581380981 learned_addr learned my addr 172.21.15.12:0/2581380981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e177fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0e1815e7b0 0x7f0e18071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46718/0 (socket says 172.21.15.12:46718) 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e17fff640 1 -- 172.21.15.12:0/2581380981 >> v1:172.21.15.100:6789/0 conn(0x7f0e180b5600 legacy=0x7f0e18073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e17fff640 1 -- 172.21.15.12:0/2581380981 >> v1:172.21.15.12:6789/0 conn(0x7f0e1815e7b0 legacy=0x7f0e18071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e167fc640 1 -- 172.21.15.12:0/2581380981 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528307970 0 0) 0x7f0e180741c0 con 0x7f0e1815e7b0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.376+0000 7f0e17fff640 1 -- 172.21.15.12:0/2581380981 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1806ebb0 con 0x7f0e1806ccb0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e17fff640 1 --2- 172.21.15.12:0/2581380981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1806ccb0 0x7f0e1806d0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009e50 tx=0x7f0e1002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606856b24287d096 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e167fc640 1 -- 172.21.15.12:0/2581380981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10036070 con 0x7f0e1806ccb0 2024-09-10T09:23:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e167fc640 1 -- 172.21.15.12:0/2581380981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10031600 con 0x7f0e1806ccb0 2024-09-10T09:23:23.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e167fc640 1 -- 172.21.15.12:0/2581380981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100319d0 con 0x7f0e1806ccb0 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e1db2a640 1 -- 172.21.15.12:0/2581380981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1806ccb0 msgr2=0x7f0e1806d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/2581380981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1806ccb0 0x7f0e1806d0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009e50 tx=0x7f0e1002a6d0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e1db2a640 1 -- 172.21.15.12:0/2581380981 shutdown_connections 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/2581380981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1806ccb0 0x7f0e1806d0d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.377+0000 7f0e1db2a640 1 -- 172.21.15.12:0/2581380981 >> 172.21.15.12:0/2581380981 conn(0x7f0e180b4300 msgr2=0x7f0e180b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.378+0000 7f0e1db2a640 1 -- 172.21.15.12:0/2581380981 shutdown_connections 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.378+0000 7f0e1db2a640 1 -- 172.21.15.12:0/2581380981 wait complete. 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.379+0000 7f0e1db2a640 1 Processor -- start 2024-09-10T09:23:23.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.379+0000 7f0e1db2a640 1 -- start start 2024-09-10T09:23:23.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e1806ccb0 0x7f0e180d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e180b5600 0x7f0e18161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 0x7f0e18146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1806d610 con 0x7f0e1815e7b0 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18073590 con 0x7f0e1806ccb0 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0e180b6ce0 con 0x7f0e180b5600 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 0x7f0e18146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 0x7f0e18146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33290/0 (socket says 172.21.15.12:33290) 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 -- 172.21.15.12:0/885857694 learned_addr learned my addr 172.21.15.12:0/885857694 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e177fe640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e1806ccb0 0x7f0e180d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e16ffd640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e180b5600 0x7f0e18161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 -- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e180b5600 msgr2=0x7f0e18161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e180b5600 0x7f0e18161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 -- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e1806ccb0 msgr2=0x7f0e180d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e1806ccb0 0x7f0e180d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 -- 172.21.15.12:0/885857694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e18145010 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e177fe640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e1806ccb0 0x7f0e180d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e17fff640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 0x7f0e18146e50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009e50 tx=0x7f0e10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10041020 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e10007780 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e181452f0 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.380+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10036040 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.381+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e18161ad0 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.381+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1806d0d0 con 0x7f0e1815e7b0 2024-09-10T09:23:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.382+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e10044020 con 0x7f0e1815e7b0 2024-09-10T09:23:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.382+0000 7f0dfffff640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0e0406be60 0x7f0e0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.382+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0e100abbf0 con 0x7f0e1815e7b0 2024-09-10T09:23:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.383+0000 7f0e177fe640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0e0406be60 0x7f0e0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.383+0000 7f0e177fe640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0e0406be60 0x7f0e0406e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0e08000f60 tx=0x7f0e08007cc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.387+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e1004b030 con 0x7f0e1815e7b0 2024-09-10T09:23:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.598+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e180b1a90 con 0x7f0e1815e7b0 2024-09-10T09:23:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.598+0000 7f0dfffff640 1 -- 172.21.15.12:0/885857694 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5223 (secure 0 0 0) 0x7f0e1007a660 con 0x7f0e1815e7b0 2024-09-10T09:23:23.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:23.599 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":14,"btime":"2024-09-10T09:23:17:104287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:23:14.438605+0000","modified":"2024-09-10T09:23:16.449169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4714":{"gid":4714,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/694322310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":694322310},{"type":"v1","addr":"172.21.15.100:6836","nonce":694322310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4714,"qdb_cluster":[4714]},"id":2}]} 2024-09-10T09:23:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 14 2024-09-10T09:23:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0e0406be60 msgr2=0x7f0e0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0e0406be60 0x7f0e0406e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0e08000f60 tx=0x7f0e08007cc0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 msgr2=0x7f0e18146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 0x7f0e18146e50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009e50 tx=0x7f0e10004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 shutdown_connections 2024-09-10T09:23:23.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0e0406be60 0x7f0e0406e320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e1815e7b0 0x7f0e18146e50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e180b5600 0x7f0e18161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 --2- 172.21.15.12:0/885857694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e1806ccb0 0x7f0e180d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 >> 172.21.15.12:0/885857694 conn(0x7f0e180b4300 msgr2=0x7f0e180b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 shutdown_connections 2024-09-10T09:23:23.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:23.600+0000 7f0e1db2a640 1 -- 172.21.15.12:0/885857694 wait complete. 2024-09-10T09:23:24.015 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T09:23:14.438605+0000', 'modified': '2024-09-10T09:23:16.449169+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4714': {'gid': 4714, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6836/694322310', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 694322310}, {'type': 'v1', 'addr': '172.21.15.100:6836', 'nonce': 694322310}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4714, 'qdb_cluster': [4714]} 2024-09-10T09:23:24.015 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T09:23:24.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T09:23:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.124+0000 7f1db1c3c640 1 Processor -- start 2024-09-10T09:23:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.124+0000 7f1db1c3c640 1 -- start start 2024-09-10T09:23:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1db1c3c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1dac15e7b0 0x7f1dac071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1db1c3c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dac06ccb0 0x7f1dac06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1db1c3c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dac071880 con 0x7f1dac0b5600 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1db1c3c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac06e680 con 0x7f1dac06ccb0 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1db1c3c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac0741c0 con 0x7f1dac15e7b0 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1dabfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dac06ccb0 0x7f1dac06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1dabfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1dac06ccb0 0x7f1dac06d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33302/0 (socket says 172.21.15.12:33302) 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1dabfff640 1 -- 172.21.15.12:0/2408172162 learned_addr learned my addr 172.21.15.12:0/2408172162 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.125+0000 7f1daaffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1dac0b5600 0x7f1dac073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46722/0 (socket says 172.21.15.12:46722) 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/2408172162 >> v2:172.21.15.100:3300/0 conn(0x7f1dac15e7b0 0x7f1dac071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dabfff640 1 -- 172.21.15.12:0/2408172162 >> v2:172.21.15.100:3300/0 conn(0x7f1dac15e7b0 msgr2=0x7f1dac071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dabfff640 1 --2- 172.21.15.12:0/2408172162 >> v2:172.21.15.100:3300/0 conn(0x7f1dac15e7b0 0x7f1dac071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dabfff640 1 -- 172.21.15.12:0/2408172162 >> v1:172.21.15.12:6789/0 conn(0x7f1dac0b5600 legacy=0x7f1dac073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dabfff640 1 -- 172.21.15.12:0/2408172162 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac06e8d0 con 0x7f1dac06ccb0 2024-09-10T09:23:24.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/2408172162 >> v2:172.21.15.100:3300/0 conn(0x7f1dac15e7b0 0x7f1dac071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:24.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1dabfff640 1 --2- 172.21.15.12:0/2408172162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac06ccb0 0x7f1dac06d0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dac050260 tx=0x7f1da402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb5347b043eddfa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.126+0000 7f1daa7fc640 1 -- 172.21.15.12:0/2408172162 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4036070 con 0x7f1dac06ccb0 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1daa7fc640 1 -- 172.21.15.12:0/2408172162 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4031600 con 0x7f1dac06ccb0 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1daa7fc640 1 -- 172.21.15.12:0/2408172162 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40319d0 con 0x7f1dac06ccb0 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 -- 172.21.15.12:0/2408172162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac06ccb0 msgr2=0x7f1dac06d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/2408172162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac06ccb0 0x7f1dac06d0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dac050260 tx=0x7f1da402a6a0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 -- 172.21.15.12:0/2408172162 shutdown_connections 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/2408172162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac06ccb0 0x7f1dac06d0d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/2408172162 >> v2:172.21.15.100:3300/0 conn(0x7f1dac15e7b0 0x7f1dac071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 -- 172.21.15.12:0/2408172162 >> 172.21.15.12:0/2408172162 conn(0x7f1dac0b4300 msgr2=0x7f1dac0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 -- 172.21.15.12:0/2408172162 shutdown_connections 2024-09-10T09:23:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.127+0000 7f1db1c3c640 1 -- 172.21.15.12:0/2408172162 wait complete. 2024-09-10T09:23:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.128+0000 7f1db1c3c640 1 Processor -- start 2024-09-10T09:23:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 -- start start 2024-09-10T09:23:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dac06ccb0 0x7f1dac1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1dac0b5600 0x7f1dac0b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 0x7f1dac1614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac073590 con 0x7f1dac15e7b0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac0732b0 con 0x7f1dac06ccb0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1db1c3c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac06d610 con 0x7f1dac0b5600 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1dabfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 0x7f1dac1614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1dabfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 0x7f1dac1614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33308/0 (socket says 172.21.15.12:33308) 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.129+0000 7f1dabfff640 1 -- 172.21.15.12:0/3893530733 learned_addr learned my addr 172.21.15.12:0/3893530733 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dac06ccb0 0x7f1dac1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1daaffd640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1dac0b5600 0x7f1dac0b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dabfff640 1 -- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1dac0b5600 msgr2=0x7f1dac0b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1dac0b5600 0x7f1dac0b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dabfff640 1 -- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dac06ccb0 msgr2=0x7f1dac1546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dac06ccb0 0x7f1dac1546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dabfff640 1 -- 172.21.15.12:0/3893530733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac1532a0 con 0x7f1dac15e7b0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 0x7f1dac1614b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009f40 tx=0x7f1da4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1d93fff640 1 -- 172.21.15.12:0/3893530733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4036050 con 0x7f1dac15e7b0 2024-09-10T09:23:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1d93fff640 1 -- 172.21.15.12:0/3893530733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4042070 con 0x7f1dac15e7b0 2024-09-10T09:23:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac153950 con 0x7f1dac15e7b0 2024-09-10T09:23:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1d93fff640 1 -- 172.21.15.12:0/3893530733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4009510 con 0x7f1dac15e7b0 2024-09-10T09:23:24.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.130+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac153f10 con 0x7f1dac15e7b0 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.132+0000 7f1d93fff640 1 -- 172.21.15.12:0/3893530733 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1da4007c70 con 0x7f1dac15e7b0 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.132+0000 7f1d93fff640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d9806be30 0x7f1d9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.132+0000 7f1d93fff640 1 -- 172.21.15.12:0/3893530733 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1da40abf40 con 0x7f1dac15e7b0 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.133+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d9806be30 0x7f1d9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.133+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d9806be30 0x7f1d9806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00b840 tx=0x7f1d9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.133+0000 7f1db49d4740 1 Processor -- start 2024-09-10T09:23:24.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.133+0000 7f1db49d4740 1 -- start start 2024-09-10T09:23:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba60a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 0x56142ba1b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba158b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1db49d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56142b97d520 con 0x56142ba18a80 2024-09-10T09:23:24.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56142b9253e0 con 0x56142ba1ca50 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x56142b9794e0 con 0x56142ba1b2c0 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 0x56142ba1b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 0x56142ba1b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33324/0 (socket says 172.21.15.12:33324) 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 -- 172.21.15.12:0/881780163 learned_addr learned my addr 172.21.15.12:0/881780163 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba60a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1dabfff640 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 -- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 msgr2=0x56142ba60a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba60a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 -- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 msgr2=0x56142ba158b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba158b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1daaffd640 1 -- 172.21.15.12:0/881780163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56142b9402f0 con 0x56142ba18a80 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.134+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba60a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.135+0000 7f1daaffd640 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 0x56142ba1b6a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1da00016a0 tx=0x7f1da0001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d454da854c5ce561 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.135+0000 7f1d917fa640 1 -- 172.21.15.12:0/881780163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0018070 con 0x56142ba18a80 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.135+0000 7f1d917fa640 1 -- 172.21.15.12:0/881780163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00074e0 con 0x56142ba18a80 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.135+0000 7f1d917fa640 1 -- 172.21.15.12:0/881780163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0007690 con 0x56142ba18a80 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.135+0000 7f1db49d4740 1 -- 172.21.15.12:0/881780163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 msgr2=0x56142ba1b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.135+0000 7f1db49d4740 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 0x56142ba1b6a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1da00016a0 tx=0x7f1da0001b60 comp rx=0 tx=0).stop 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 -- 172.21.15.12:0/881780163 shutdown_connections 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba18a80 0x56142ba1b6a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 --2- 172.21.15.12:0/881780163 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba60a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 -- 172.21.15.12:0/881780163 >> 172.21.15.12:0/881780163 conn(0x56142ba17a80 msgr2=0x56142ba5ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 -- 172.21.15.12:0/881780163 shutdown_connections 2024-09-10T09:23:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 -- 172.21.15.12:0/881780163 wait complete. 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 -- start start 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.136+0000 7f1db49d4740 1 Processor -- start 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba5d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba44e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1a400 0x56142ba1a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56142ba16f20 con 0x56142ba1ca50 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56142b906450 con 0x56142ba1a400 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x56142ba61290 con 0x56142ba1b2c0 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1db49d4740 10 client.0 _ll_register_callbacks cb 0x56142b68fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba44e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba44e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33340/0 (socket says 172.21.15.12:33340) 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 -- 172.21.15.12:0/3940039978 learned_addr learned my addr 172.21.15.12:0/3940039978 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1a400 0x56142ba1a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 -- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 msgr2=0x56142ba5d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba5d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 -- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1a400 msgr2=0x56142ba1a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1a400 0x56142ba1a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.137+0000 7f1daaffd640 1 -- 172.21.15.12:0/3940039978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56142b6902d0 con 0x56142ba1ca50 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1daaffd640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba44e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1da0004e40 tx=0x7f1da0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18219be82c7f651d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1d8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/3940039978 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0021020 con 0x56142ba1ca50 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1da00074e0 con 0x56142ba1ca50 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/3940039978 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1da00011b0 con 0x56142ba1ca50 2024-09-10T09:23:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/3940039978 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1da002b050 con 0x56142ba1ca50 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 10 client.4956 fetch_fsmap learned FSMap version 14 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56142b75a6b0 con 0x56142ba1ca50 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/3940039978 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00074e0 con 0x56142ba1ca50 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/3940039978 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f1da002e020 con 0x56142ba1ca50 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 10 client.4956 fetch_fsmap finished waiting for FSMap version 14 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 10 client.4956 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 20 client.4956 populate_metadata read hostname 'smithi012' 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba72350 0x56142ba72730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 4 client.4956 mds_command: new command op to 4714 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T09:23:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 --> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56142b98ac50 con 0x56142ba72350 2024-09-10T09:23:24.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.138+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba72350 0x56142ba72730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.139+0000 7f1d8a7fc640 10 client.4956 ms_handle_connect on v2:172.21.15.100:6834/694322310 2024-09-10T09:23:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.139+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba72350 0x56142ba72730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a082c83fd24912b0 server_cookie=bd23399db2ad50df in_seq=0 out_seq=0 2024-09-10T09:23:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/3940039978 <== mds.0 v2:172.21.15.100:6834/694322310 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56142b98ac50 con 0x56142ba72350 2024-09-10T09:23:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1d8a7fc640 10 client.4956 handle_command_reply: tid=0 2024-09-10T09:23:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 client.4956 shutdown 2024-09-10T09:23:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 msgr2=0x56142ba44e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba44e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1da0004e40 tx=0x7f1da0000bc0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 shutdown_connections 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba72350 0x56142ba72730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1a400 0x56142ba1a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1d8a7fc640 0 client.4956 ms_handle_reset on v2:172.21.15.100:6834/694322310 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba44e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3940039978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba5d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 >> 172.21.15.12:0/3940039978 conn(0x56142ba18a80 msgr2=0x56142ba40230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 shutdown_connections 2024-09-10T09:23:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 1 -- 172.21.15.12:0/3940039978 wait complete. 2024-09-10T09:23:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.140+0000 7f1db49d4740 20 client.4956 trim_cache size 0 max 16384 2024-09-10T09:23:24.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.158+0000 7f1db49d4740 1 Processor -- start 2024-09-10T09:23:24.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 -- start start 2024-09-10T09:23:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1a400 0x56142ba5c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1b2c0 0x56142ba5ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1f8890 con 0x56142ba1ca50 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac157530 con 0x56142ba1b2c0 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac157b80 con 0x56142ba1a400 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.159+0000 7f1dabfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33348/0 (socket says 172.21.15.12:33348) 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 -- 172.21.15.12:0/3707293548 learned_addr learned my addr 172.21.15.12:0/3707293548 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1a400 0x56142ba5c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1daaffd640 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1b2c0 0x56142ba5ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 -- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1a400 msgr2=0x56142ba5c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1a400 0x56142ba5c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 -- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1b2c0 msgr2=0x56142ba5ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1b2c0 0x56142ba5ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 -- 172.21.15.12:0/3707293548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56142ba44280 con 0x56142ba1ca50 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1a400 0x56142ba5c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1dabfff640 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1da4044ff0 tx=0x7f1da4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16402b98c4dc3db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1d90ff9640 1 -- 172.21.15.12:0/3707293548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40a8070 con 0x56142ba1ca50 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1d90ff9640 1 -- 172.21.15.12:0/3707293548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4037040 con 0x56142ba1ca50 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.160+0000 7f1d90ff9640 1 -- 172.21.15.12:0/3707293548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da407a8f0 con 0x56142ba1ca50 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 -- 172.21.15.12:0/3707293548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 msgr2=0x56142ba5f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1da4044ff0 tx=0x7f1da4009b30 comp rx=0 tx=0).stop 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 -- 172.21.15.12:0/3707293548 shutdown_connections 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1b2c0 0x56142ba5ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 --2- 172.21.15.12:0/3707293548 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1a400 0x56142ba5c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 -- 172.21.15.12:0/3707293548 >> 172.21.15.12:0/3707293548 conn(0x56142ba18a80 msgr2=0x56142ba3e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 -- 172.21.15.12:0/3707293548 shutdown_connections 2024-09-10T09:23:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 -- 172.21.15.12:0/3707293548 wait complete. 2024-09-10T09:23:24.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 -- start start 2024-09-10T09:23:24.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.161+0000 7f1db49d4740 1 Processor -- start 2024-09-10T09:23:24.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 0x56142badf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56142ba71ad0 con 0x56142ba1a400 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56142ba71510 con 0x56142ba1ca50 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x56142ba43290 con 0x56142ba1b2c0 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1db49d4740 10 client.0 _ll_register_callbacks cb 0x7f1da0016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 0x56142badf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1dab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 0x56142badf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33352/0 (socket says 172.21.15.12:33352) 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1dab7fe640 1 -- 172.21.15.12:0/2736916267 learned_addr learned my addr 172.21.15.12:0/2736916267 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1daaffd640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.162+0000 7f1dabfff640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1dab7fe640 1 -- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 msgr2=0x56142ba836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1dab7fe640 1 -- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 msgr2=0x56142ba5f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1dab7fe640 1 -- 172.21.15.12:0/2736916267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56142ba83c00 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1dab7fe640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 0x56142badf780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x56142ba43410 tx=0x7f1d9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b70240290d97715 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1d8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/2736916267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c02e060 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/2736916267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1d9c022c90 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1da4037040 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/2736916267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c034050 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 10 client.4962 fetch_fsmap learned FSMap version 14 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56142ba462f0 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/2736916267 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4037040 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/2736916267 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f1d9c037020 con 0x56142ba1a400 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 10 client.4962 fetch_fsmap finished waiting for FSMap version 14 2024-09-10T09:23:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 10 client.4962 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 20 client.4962 populate_metadata read hostname 'smithi012' 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.163+0000 7f1db49d4740 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba5d030 0x56142ba41340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 4 client.4962 mds_command: new command op to 4714 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 --> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] -- command(tid 0: {"prefix": "status"}) -- 0x56142b984fa0 con 0x56142ba5d030 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1daaffd640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba5d030 0x56142ba41340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1daaffd640 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba5d030 0x56142ba41340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da2a4f06b6b7121 server_cookie=ff4c85497456fbc1 in_seq=0 out_seq=0 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1d8a7fc640 10 client.4962 ms_handle_connect on v2:172.21.15.100:6834/694322310 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1d8a7fc640 1 -- 172.21.15.12:0/2736916267 <== mds.0 v2:172.21.15.100:6834/694322310 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56142b984fa0 con 0x56142ba5d030 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1d8a7fc640 10 client.4962 handle_command_reply: tid=0 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 1 client.4962 shutdown 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 msgr2=0x56142badf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 0x56142badf780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x56142ba43410 tx=0x7f1d9c004730 comp rx=0 tx=0).stop 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 shutdown_connections 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.164+0000 7f1db49d4740 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:6834/694322310,v1:172.21.15.100:6836/694322310] conn(0x56142ba5d030 0x56142ba41340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56142ba1ca50 0x56142ba5f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1d8a7fc640 0 client.4962 ms_handle_reset on v2:172.21.15.100:6834/694322310 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56142ba1b2c0 0x56142ba836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 1 --2- 172.21.15.12:0/2736916267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56142ba1a400 0x56142badf780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 >> 172.21.15.12:0/2736916267 conn(0x56142ba18a80 msgr2=0x56142ba197d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 shutdown_connections 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 1 -- 172.21.15.12:0/2736916267 wait complete. 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db49d4740 20 client.4962 trim_cache size 0 max 16384 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "b13fea51-e2df-43f6-8889-422976fa1401", 2024-09-10T09:23:24.171 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4714, 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 9.0604925939999994, 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 14, 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 32, 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 32, 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 15.954428868999999 2024-09-10T09:23:24.172 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d9806be30 msgr2=0x7f1d9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d9806be30 0x7f1d9806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00b840 tx=0x7f1d9c008040 comp rx=0 tx=0).stop 2024-09-10T09:23:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 msgr2=0x7f1dac1614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 0x7f1dac1614b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009f40 tx=0x7f1da4004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 shutdown_connections 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d9806be30 0x7f1d9806e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1dac15e7b0 0x7f1dac1614b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1dac0b5600 0x7f1dac0b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 --2- 172.21.15.12:0/3893530733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dac06ccb0 0x7f1dac1546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 >> 172.21.15.12:0/3893530733 conn(0x7f1dac0b4300 msgr2=0x7f1dac0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 shutdown_connections 2024-09-10T09:23:24.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.165+0000 7f1db1c3c640 1 -- 172.21.15.12:0/3893530733 wait complete. 2024-09-10T09:23:24.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T09:23:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.279+0000 7f29ad8d0640 1 Processor -- start 2024-09-10T09:23:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.279+0000 7f29ad8d0640 1 -- start start 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.279+0000 7f29ad8d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f29a815c180 0x7f29a80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29ad8d0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f29a8073120 0x7f29a8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29ad8d0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80ce740 con 0x7f29a80ce230 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29ad8d0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f29a8072640 con 0x7f29a8073120 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29ad8d0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f29a8072920 con 0x7f29a815c180 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f29a8073120 0x7f29a8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f29a8073120 0x7f29a8073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33364/0 (socket says 172.21.15.12:33364) 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 -- 172.21.15.12:0/3209179722 learned_addr learned my addr 172.21.15.12:0/3209179722 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a6ffd640 1 --2- 172.21.15.12:0/3209179722 >> v2:172.21.15.100:3300/0 conn(0x7f29a815c180 0x7f29a80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 -- 172.21.15.12:0/3209179722 >> v2:172.21.15.100:3300/0 conn(0x7f29a815c180 msgr2=0x7f29a80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 --2- 172.21.15.12:0/3209179722 >> v2:172.21.15.100:3300/0 conn(0x7f29a815c180 0x7f29a80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 -- 172.21.15.12:0/3209179722 >> v1:172.21.15.100:6789/0 conn(0x7f29a80ce230 legacy=0x7f29a80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.280+0000 7f29a77fe640 1 -- 172.21.15.12:0/3209179722 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a8072c00 con 0x7f29a8073120 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29a77fe640 1 --2- 172.21.15.12:0/3209179722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a8073120 0x7f29a8073570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f29a806cc10 tx=0x7f299802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953e1978eafeac9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29a5ffb640 1 -- 172.21.15.12:0/3209179722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998037070 con 0x7f29a8073120 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29a5ffb640 1 -- 172.21.15.12:0/3209179722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2998032440 con 0x7f29a8073120 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29a5ffb640 1 -- 172.21.15.12:0/3209179722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998032810 con 0x7f29a8073120 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 -- 172.21.15.12:0/3209179722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a8073120 msgr2=0x7f29a8073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/3209179722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a8073120 0x7f29a8073570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f29a806cc10 tx=0x7f299802a1a0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 -- 172.21.15.12:0/3209179722 shutdown_connections 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/3209179722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a8073120 0x7f29a8073570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/3209179722 >> v2:172.21.15.100:3300/0 conn(0x7f29a815c180 0x7f29a80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 -- 172.21.15.12:0/3209179722 >> 172.21.15.12:0/3209179722 conn(0x7f29a8062cc0 msgr2=0x7f29a806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.281+0000 7f29ad8d0640 1 -- 172.21.15.12:0/3209179722 shutdown_connections 2024-09-10T09:23:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.282+0000 7f29ad8d0640 1 -- 172.21.15.12:0/3209179722 wait complete. 2024-09-10T09:23:24.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.283+0000 7f29ad8d0640 1 Processor -- start 2024-09-10T09:23:24.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.283+0000 7f29ad8d0640 1 -- start start 2024-09-10T09:23:24.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a8073120 0x7f29a814d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a80ce230 0x7f29a81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 0x7f29a815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80cf780 con 0x7f29a815c180 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80722f0 con 0x7f29a8073120 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f29a815c560 con 0x7f29a80ce230 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 0x7f29a815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 0x7f29a815f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33366/0 (socket says 172.21.15.12:33366) 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 -- 172.21.15.12:0/1051187519 learned_addr learned my addr 172.21.15.12:0/1051187519 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a6ffd640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a8073120 0x7f29a814d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a67fc640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a80ce230 0x7f29a81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 -- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a80ce230 msgr2=0x7f29a81502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a80ce230 0x7f29a81502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 -- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a8073120 msgr2=0x7f29a814d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a8073120 0x7f29a814d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 -- 172.21.15.12:0/1051187519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a815f8c0 con 0x7f29a815c180 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29a77fe640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 0x7f29a815f150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2998009960 tx=0x7f29980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998037040 con 0x7f29a815c180 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2998042070 con 0x7f29a815c180 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a81f31c0 con 0x7f29a815c180 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998030c90 con 0x7f29a815c180 2024-09-10T09:23:24.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.284+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a81f3780 con 0x7f29a815c180 2024-09-10T09:23:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.286+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a81f3980 con 0x7f29a815c180 2024-09-10T09:23:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.286+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2998047460 con 0x7f29a815c180 2024-09-10T09:23:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.287+0000 7f299ffff640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f298806be30 0x7f298806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.287+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f29980ab990 con 0x7f29a815c180 2024-09-10T09:23:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.287+0000 7f29a6ffd640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f298806be30 0x7f298806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.287+0000 7f29a6ffd640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f298806be30 0x7f298806e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29a000f510 tx=0x7f29a00077b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.291+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29a81f3980 con 0x7f29a815c180 2024-09-10T09:23:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.504+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29a80cdcf0 con 0x7f29a815c180 2024-09-10T09:23:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.505+0000 7f299ffff640 1 -- 172.21.15.12:0/1051187519 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f2998079ce0 con 0x7f29a815c180 2024-09-10T09:23:24.506 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f298806be30 msgr2=0x7f298806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f298806be30 0x7f298806e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29a000f510 tx=0x7f29a00077b0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 msgr2=0x7f29a815f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 0x7f29a815f150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2998009960 tx=0x7f29980046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 shutdown_connections 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f298806be30 0x7f298806e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a815c180 0x7f29a815f150 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a80ce230 0x7f29a81502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 --2- 172.21.15.12:0/1051187519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a8073120 0x7f29a814d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 >> 172.21.15.12:0/1051187519 conn(0x7f29a8062cc0 msgr2=0x7f29a8158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 shutdown_connections 2024-09-10T09:23:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24.507+0000 7f29ad8d0640 1 -- 172.21.15.12:0/1051187519 wait complete. 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T09:23:24.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T09:23:24.520 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:23:24.520 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:23:24.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:24.520 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-10T09:23:24.537 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42710sec preferred_lft 42710sec 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 2a:0e:de:dd:8d:e3 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.538 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a42d:f8ff:fe27:99f/64 scope link 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 2a:0e:de:dd:8d:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::280e:deff:fedd:8de3/64 scope link 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether de:0a:8f:f6:8a:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::dc0a:8fff:fef6:8a95/64 scope link 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:24.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:24.540 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:23:24.601 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-10T09:23:24.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:24.602 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-10T09:23:24.660 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-10T09:23:24.660 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:23:24.660 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T09:23:24.660 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T09:23:24.660 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:23:24.661 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:23:24.661 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-10T09:23:24.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T09:23:24.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T09:23:24.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T09:23:24.661 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-10T09:23:24.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:23:24.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:23:24.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:24.789 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:23:24.805 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T09:23:24.805 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T09:23:24.805 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:23:24.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:24.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-10T09:23:24.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:23:24.872 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T09:23:24.927 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:23:24.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:23:24.928 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T09:23:24.983 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:23:24.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:24.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:23:25.068 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:23:25.068 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:23:25.069 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:23:25.077 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:23:25.077 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:23:25.077 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:23:25.077 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:23:25.077 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:23:25.088 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:23:25.088 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:23:25.088 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2024-09-10T09:23:25.088 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790" 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790:/ 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=b13fea51-e2df-43f6-8889-422976fa1401" will pass to kernel 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:23:25.089 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:23:25.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:23:25.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:25.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T09:23:25.117 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:23:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:23:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:23:25.222 INFO:teuthology.orchestra.run.smithi012.stdout:client4706 2024-09-10T09:23:25.222 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:25.222 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:25.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T09:23:25.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 Processor -- start 2024-09-10T09:23:25.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 -- start start 2024-09-10T09:23:25.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f136815e940 0x7f13680d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:25.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f136815ed20 0x7f13680d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13680b7170 con 0x7f13680cef90 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f13680d1ae0 con 0x7f136815ed20 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.383+0000 7f136e677640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f13680b7aa0 con 0x7f136815e940 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f135ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f136815ed20 0x7f13680d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f136cc14640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f13680cef90 0x7f13680b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46728/0 (socket says 172.21.15.12:46728) 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f136cc14640 1 -- 172.21.15.12:0/1966878688 learned_addr learned my addr 172.21.15.12:0/1966878688 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f135ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f136815ed20 0x7f13680d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33380/0 (socket says 172.21.15.12:33380) 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f1367fff640 1 --2- 172.21.15.12:0/1966878688 >> v2:172.21.15.100:3300/0 conn(0x7f136815e940 0x7f13680d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f135ffff640 1 -- 172.21.15.12:0/1966878688 >> v2:172.21.15.100:3300/0 conn(0x7f136815e940 msgr2=0x7f13680d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f135ffff640 1 --2- 172.21.15.12:0/1966878688 >> v2:172.21.15.100:3300/0 conn(0x7f136815e940 0x7f13680d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f135ffff640 1 -- 172.21.15.12:0/1966878688 >> v1:172.21.15.12:6789/0 conn(0x7f13680cef90 legacy=0x7f13680b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f13677fe640 1 -- 172.21.15.12:0/1966878688 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007128515 0 0) 0x7f1360001490 con 0x7f13680cef90 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f135ffff640 1 -- 172.21.15.12:0/1966878688 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13680d3660 con 0x7f136815ed20 2024-09-10T09:23:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.384+0000 7f1367fff640 1 --2- 172.21.15.12:0/1966878688 >> v2:172.21.15.100:3300/0 conn(0x7f136815e940 0x7f13680d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:25.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.385+0000 7f135ffff640 1 --2- 172.21.15.12:0/1966878688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13680d15a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f13680509d0 tx=0x7f135002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1cda9a9a37f30d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:25.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.385+0000 7f13677fe640 1 -- 172.21.15.12:0/1966878688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350037070 con 0x7f136815ed20 2024-09-10T09:23:25.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.385+0000 7f13677fe640 1 -- 172.21.15.12:0/1966878688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1350032440 con 0x7f136815ed20 2024-09-10T09:23:25.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.385+0000 7f13677fe640 1 -- 172.21.15.12:0/1966878688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350032810 con 0x7f136815ed20 2024-09-10T09:23:25.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.385+0000 7f136e677640 1 -- 172.21.15.12:0/1966878688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 msgr2=0x7f13680d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.385+0000 7f136e677640 1 --2- 172.21.15.12:0/1966878688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13680d15a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f13680509d0 tx=0x7f135002a230 comp rx=0 tx=0).stop 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.386+0000 7f136e677640 1 -- 172.21.15.12:0/1966878688 shutdown_connections 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.386+0000 7f136e677640 1 --2- 172.21.15.12:0/1966878688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13680d15a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.386+0000 7f136e677640 1 --2- 172.21.15.12:0/1966878688 >> v2:172.21.15.100:3300/0 conn(0x7f136815e940 0x7f13680d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.386+0000 7f136e677640 1 -- 172.21.15.12:0/1966878688 >> 172.21.15.12:0/1966878688 conn(0x7f13680b6240 msgr2=0x7f13680b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.386+0000 7f136e677640 1 -- 172.21.15.12:0/1966878688 shutdown_connections 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.386+0000 7f136e677640 1 -- 172.21.15.12:0/1966878688 wait complete. 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.387+0000 7f136e677640 1 Processor -- start 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.387+0000 7f136e677640 1 -- start start 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13680cef90 0x7f13681e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f136815e940 0x7f13681e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13681476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:25.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13680d3f00 con 0x7f136815ed20 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13680d3c20 con 0x7f13680cef90 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f13680d3310 con 0x7f136815e940 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13681476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13681476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33390/0 (socket says 172.21.15.12:33390) 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 -- 172.21.15.12:0/1013377331 learned_addr learned my addr 172.21.15.12:0/1013377331 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f135ffff640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f136815e940 0x7f13681e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f1367fff640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13680cef90 0x7f13681e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 -- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f136815e940 msgr2=0x7f13681e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f136815e940 0x7f13681e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 -- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13680cef90 msgr2=0x7f13681e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13680cef90 0x7f13681e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 -- 172.21.15.12:0/1013377331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13681456e0 con 0x7f136815ed20 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136cc14640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13681476d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f136000c700 tx=0x7f136000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360018070 con 0x7f136815ed20 2024-09-10T09:23:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136000ce10 con 0x7f136815ed20 2024-09-10T09:23:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13681459c0 con 0x7f136815ed20 2024-09-10T09:23:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.388+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136000a860 con 0x7f136815ed20 2024-09-10T09:23:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.389+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13680ce500 con 0x7f136815ed20 2024-09-10T09:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.390+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13680d1ef0 con 0x7f136815ed20 2024-09-10T09:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.390+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f136001b070 con 0x7f136815ed20 2024-09-10T09:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.390+0000 7f13657fa640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f134806be30 0x7f134806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.391+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f136008a480 con 0x7f136815ed20 2024-09-10T09:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.391+0000 7f1367fff640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f134806be30 0x7f134806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.391+0000 7f1367fff640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f134806be30 0x7f134806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f135800a990 tx=0x7f1358008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.395+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13680b7170 con 0x7f136815ed20 2024-09-10T09:23:25.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.608+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f13680ba6b0 con 0x7f136815ed20 2024-09-10T09:23:25.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.608+0000 7f13657fa640 1 -- 172.21.15.12:0/1013377331 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f1360058e20 con 0x7f136815ed20 2024-09-10T09:23:25.609 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f134806be30 msgr2=0x7f134806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f134806be30 0x7f134806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f135800a990 tx=0x7f1358008040 comp rx=0 tx=0).stop 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 msgr2=0x7f13681476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13681476d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f136000c700 tx=0x7f136000cbc0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 shutdown_connections 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f134806be30 0x7f134806e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f136815ed20 0x7f13681476d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f136815e940 0x7f13681e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 --2- 172.21.15.12:0/1013377331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13680cef90 0x7f13681e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 >> 172.21.15.12:0/1013377331 conn(0x7f13680b6240 msgr2=0x7f13680b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 shutdown_connections 2024-09-10T09:23:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:25.610+0000 7f136e677640 1 -- 172.21.15.12:0/1013377331 wait complete. 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:23:25.622 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:23:25.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:25.623 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-10T09:23:25.642 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:23:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:25.643 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42746sec preferred_lft 42746sec 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2e:98:26:58:9a:17 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::28ae:d2ff:fe1b:df05/64 scope link 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.644 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether b6:ca:b4:6a:81:ad brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::b4ca:b4ff:fe6a:81ad/64 scope link 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2e:98:26:58:9a:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::2c98:26ff:fe58:9a17/64 scope link 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:23:25.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:25.645 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:23:25.711 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-10T09:23:25.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:25.717 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-10T09:23:25.776 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-10T09:23:25.776 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:23:25.776 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T09:23:25.776 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T09:23:25.776 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:23:25.776 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:23:25.777 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-10T09:23:25.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T09:23:25.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T09:23:25.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T09:23:25.777 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-10T09:23:25.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:23:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:23:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:23:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:23:25.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:25.909 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:23:25.925 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T09:23:25.925 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T09:23:25.926 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:23:25.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:25.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-10T09:23:25.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:23:25.992 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T09:23:26.047 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:23:26.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:23:26.048 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T09:23:26.103 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:23:26.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:26.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:23:26.186 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:23:26.186 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:23:26.186 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:23:26.194 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:23:26.195 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:23:26.195 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:23:26.195 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:23:26.195 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:23:26.203 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:23:26.203 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:23:26.203 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-10T09:23:26.203 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-09-10T09:23:26.204 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:23:26.204 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790" 2024-09-10T09:23:26.204 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.100:6789,172.21.15.100:6790:/ 2024-09-10T09:23:26.204 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=b13fea51-e2df-43f6-8889-422976fa1401" will pass to kernel 2024-09-10T09:23:26.209 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T09:23:26.209 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:23:26.210 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:23:26.210 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:23:26.210 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:23:26.210 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:23:26.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:26.210 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T09:23:26.276 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:23:26.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:23:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:23:26.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T09:23:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:23:26.371 INFO:teuthology.orchestra.run.smithi100.stdout:client4873 2024-09-10T09:23:26.371 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:26.371 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:26.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-10T09:23:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.507+0000 7f9258bcf640 1 Processor -- start 2024-09-10T09:23:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.507+0000 7f9258bcf640 1 -- start start 2024-09-10T09:23:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9258bcf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9254145d90 0x7f92540ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9258bcf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92540cd490 0x7f92540cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9258bcf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92540b4240 con 0x7f92540cfb10 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9258bcf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f925406d080 con 0x7f92540cd490 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9258bcf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f92540b4520 con 0x7f9254145d90 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9251d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92540cd490 0x7f92540cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9251d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92540cd490 0x7f92540cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33402/0 (socket says 172.21.15.12:33402) 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f9251d9b640 1 -- 172.21.15.12:0/2107419643 learned_addr learned my addr 172.21.15.12:0/2107419643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.508+0000 7f925259c640 1 --2- 172.21.15.12:0/2107419643 >> v2:172.21.15.100:3300/0 conn(0x7f9254145d90 0x7f92540ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.509+0000 7f9251d9b640 1 -- 172.21.15.12:0/2107419643 >> v2:172.21.15.100:3300/0 conn(0x7f9254145d90 msgr2=0x7f92540ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.509+0000 7f9251d9b640 1 --2- 172.21.15.12:0/2107419643 >> v2:172.21.15.100:3300/0 conn(0x7f9254145d90 0x7f92540ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.509+0000 7f9251d9b640 1 -- 172.21.15.12:0/2107419643 >> v1:172.21.15.100:6789/0 conn(0x7f92540cfb10 legacy=0x7f92541601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.509+0000 7f9251d9b640 1 -- 172.21.15.12:0/2107419643 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92540b4800 con 0x7f92540cd490 2024-09-10T09:23:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.509+0000 7f9251d9b640 1 --2- 172.21.15.12:0/2107419643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f92540cf5d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f925406f430 tx=0x7f923c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8524b0c04311fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f925159a640 1 -- 172.21.15.12:0/2107419643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c037070 con 0x7f92540cd490 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f925159a640 1 -- 172.21.15.12:0/2107419643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c032440 con 0x7f92540cd490 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f925159a640 1 -- 172.21.15.12:0/2107419643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c032810 con 0x7f92540cd490 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 -- 172.21.15.12:0/2107419643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 msgr2=0x7f92540cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 --2- 172.21.15.12:0/2107419643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f92540cf5d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f925406f430 tx=0x7f923c02a270 comp rx=0 tx=0).stop 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 -- 172.21.15.12:0/2107419643 shutdown_connections 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 --2- 172.21.15.12:0/2107419643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f92540cf5d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 --2- 172.21.15.12:0/2107419643 >> v2:172.21.15.100:3300/0 conn(0x7f9254145d90 0x7f92540ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 -- 172.21.15.12:0/2107419643 >> 172.21.15.12:0/2107419643 conn(0x7f925406bba0 msgr2=0x7f925406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 -- 172.21.15.12:0/2107419643 shutdown_connections 2024-09-10T09:23:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.510+0000 7f9258bcf640 1 -- 172.21.15.12:0/2107419643 wait complete. 2024-09-10T09:23:26.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.512+0000 7f9258bcf640 1 Processor -- start 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.512+0000 7f9258bcf640 1 -- start start 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9258bcf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f925415f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9258bcf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92540cfb10 0x7f92541f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9258bcf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9254145d90 0x7f92541f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9258bcf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92540b5610 con 0x7f92540cd490 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9258bcf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92540cff80 con 0x7f92540cfb10 2024-09-10T09:23:26.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9258bcf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f92540b5790 con 0x7f9254145d90 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f925259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f925415f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92540cfb10 0x7f92541f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f925259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f925415f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33404/0 (socket says 172.21.15.12:33404) 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f925259c640 1 -- 172.21.15.12:0/1703177184 learned_addr learned my addr 172.21.15.12:0/1703177184 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9252d9d640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9254145d90 0x7f92541f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 -- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9254145d90 msgr2=0x7f92541f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9254145d90 0x7f92541f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 -- 172.21.15.12:0/1703177184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 msgr2=0x7f925415f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f925415f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 -- 172.21.15.12:0/1703177184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92541f2f10 con 0x7f92540cfb10 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f925259c640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f925415f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:26.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.513+0000 7f9251d9b640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92540cfb10 0x7f92541f29d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f923c031000 tx=0x7f923c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.514+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c041030 con 0x7f92540cfb10 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.514+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c030440 con 0x7f92540cfb10 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.514+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925415e1c0 con 0x7f92540cfb10 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.514+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c037040 con 0x7f92540cfb10 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.514+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925415e780 con 0x7f92540cfb10 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.515+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9254146170 con 0x7f92540cfb10 2024-09-10T09:23:26.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.515+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f923c044070 con 0x7f92540cfb10 2024-09-10T09:23:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.516+0000 7f924affd640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f923406be30 0x7f923406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.516+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f923c0ab370 con 0x7f92540cfb10 2024-09-10T09:23:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.516+0000 7f925259c640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f923406be30 0x7f923406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:26.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.516+0000 7f925259c640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f923406be30 0x7f923406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9244009a40 tx=0x7f924400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:26.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.520+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92541f2f10 con 0x7f92540cfb10 2024-09-10T09:23:26.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:26.732+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f92540b1d20 con 0x7f92540cfb10 2024-09-10T09:23:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.305+0000 7f924affd640 1 -- 172.21.15.12:0/1703177184 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f923c079630 con 0x7f92540cfb10 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f923406be30 msgr2=0x7f923406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f923406be30 0x7f923406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9244009a40 tx=0x7f924400b040 comp rx=0 tx=0).stop 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92540cfb10 msgr2=0x7f92541f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92540cfb10 0x7f92541f29d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f923c031000 tx=0x7f923c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 shutdown_connections 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f923406be30 0x7f923406e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9254145d90 0x7f92541f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92540cfb10 0x7f92541f29d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 --2- 172.21.15.12:0/1703177184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92540cd490 0x7f925415f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 >> 172.21.15.12:0/1703177184 conn(0x7f925406bba0 msgr2=0x7f92540b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:27.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 shutdown_connections 2024-09-10T09:23:27.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.308+0000 7f9258bcf640 1 -- 172.21.15.12:0/1703177184 wait complete. 2024-09-10T09:23:27.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-10T09:23:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.432+0000 7f4eecfbd640 1 Processor -- start 2024-09-10T09:23:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.432+0000 7f4eecfbd640 1 -- start start 2024-09-10T09:23:27.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4eecfbd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ee815e500 0x7f4ee80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4eecfbd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee815e8e0 0x7f4ee80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4eecfbd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee8074200 con 0x7f4ee8073cb0 2024-09-10T09:23:27.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4eecfbd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee80b6e80 con 0x7f4ee815e500 2024-09-10T09:23:27.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4eecfbd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee80b7160 con 0x7f4ee815e8e0 2024-09-10T09:23:27.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ee815e500 0x7f4ee80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee6d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ee8073cb0 0x7f4ee81622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46730/0 (socket says 172.21.15.12:46730) 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee6d9d640 1 -- 172.21.15.12:0/1908199691 learned_addr learned my addr 172.21.15.12:0/1908199691 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4eddd9b640 1 --2- 172.21.15.12:0/1908199691 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee815e8e0 0x7f4ee80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee659c640 1 -- 172.21.15.12:0/1908199691 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee815e8e0 msgr2=0x7f4ee80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee659c640 1 --2- 172.21.15.12:0/1908199691 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee815e8e0 0x7f4ee80b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee659c640 1 -- 172.21.15.12:0/1908199691 >> v1:172.21.15.12:6789/0 conn(0x7f4ee8073cb0 legacy=0x7f4ee81622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee5d9b640 1 -- 172.21.15.12:0/1908199691 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525274395 0 0) 0x7f4ee8074200 con 0x7f4ee8073cb0 2024-09-10T09:23:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.433+0000 7f4ee659c640 1 -- 172.21.15.12:0/1908199691 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee80b7440 con 0x7f4ee815e500 2024-09-10T09:23:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.434+0000 7f4ee659c640 1 --2- 172.21.15.12:0/1908199691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e500 0x7f4ee80b4460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80097a0 tx=0x7f4ed802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9425207252585c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.434+0000 7f4ee5d9b640 1 -- 172.21.15.12:0/1908199691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8037070 con 0x7f4ee815e500 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.434+0000 7f4ee5d9b640 1 -- 172.21.15.12:0/1908199691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed802ae50 con 0x7f4ee815e500 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.434+0000 7f4ee5d9b640 1 -- 172.21.15.12:0/1908199691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8032660 con 0x7f4ee815e500 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 -- 172.21.15.12:0/1908199691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e500 msgr2=0x7f4ee80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/1908199691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e500 0x7f4ee80b4460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80097a0 tx=0x7f4ed802a100 comp rx=0 tx=0).stop 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 -- 172.21.15.12:0/1908199691 shutdown_connections 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/1908199691 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee815e8e0 0x7f4ee80b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/1908199691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e500 0x7f4ee80b4460 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 -- 172.21.15.12:0/1908199691 >> 172.21.15.12:0/1908199691 conn(0x7f4ee8062810 msgr2=0x7f4ee8062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 -- 172.21.15.12:0/1908199691 shutdown_connections 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.435+0000 7f4eecfbd640 1 -- 172.21.15.12:0/1908199691 wait complete. 2024-09-10T09:23:27.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.436+0000 7f4eecfbd640 1 Processor -- start 2024-09-10T09:23:27.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.436+0000 7f4eecfbd640 1 -- start start 2024-09-10T09:23:27.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eecfbd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee8073cb0 0x7f4ee81e9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eecfbd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee815e500 0x7f4ee81e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eecfbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 0x7f4ee81f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eecfbd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee806ce30 con 0x7f4ee815e8e0 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eecfbd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee806ccb0 con 0x7f4ee815e500 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eecfbd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee80d1cf0 con 0x7f4ee8073cb0 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 0x7f4ee81f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 0x7f4ee81f7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33418/0 (socket says 172.21.15.12:33418) 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 -- 172.21.15.12:0/3906932470 learned_addr learned my addr 172.21.15.12:0/3906932470 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee659c640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee8073cb0 0x7f4ee81e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4eddd9b640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee815e500 0x7f4ee81e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 -- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee8073cb0 msgr2=0x7f4ee81e9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee8073cb0 0x7f4ee81e9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 -- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee815e500 msgr2=0x7f4ee81e9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee815e500 0x7f4ee81e9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 -- 172.21.15.12:0/3906932470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee81e6170 con 0x7f4ee815e8e0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.437+0000 7f4ee6d9d640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 0x7f4ee81f7e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000c7a0 tx=0x7f4ee000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.438+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0018070 con 0x7f4ee815e8e0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.438+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee000a640 con 0x7f4ee815e8e0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.438+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000aab0 con 0x7f4ee815e8e0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.438+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee81e6450 con 0x7f4ee815e8e0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.438+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee81e6a10 con 0x7f4ee815e8e0 2024-09-10T09:23:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.439+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee80b4460 con 0x7f4ee815e8e0 2024-09-10T09:23:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.439+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ee001b070 con 0x7f4ee815e8e0 2024-09-10T09:23:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.440+0000 7f4edf7fe640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4ec806be30 0x7f4ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.440+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4ee008a470 con 0x7f4ee815e8e0 2024-09-10T09:23:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.440+0000 7f4ee659c640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4ec806be30 0x7f4ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.441+0000 7f4ee659c640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4ec806be30 0x7f4ec806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8034000 tx=0x7f4ed802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.444+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ee0058e20 con 0x7f4ee815e8e0 2024-09-10T09:23:27.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.643+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f4ee8069160 con 0x7f4ec806be30 2024-09-10T09:23:27.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.645+0000 7f4edf7fe640 1 -- 172.21.15.12:0/3906932470 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f4ee8069160 con 0x7f4ec806be30 2024-09-10T09:23:27.646 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-10T09:23:27.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:27.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2024-09-10T09:23:27.646 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:27.646 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4ec806be30 msgr2=0x7f4ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4ec806be30 0x7f4ec806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8034000 tx=0x7f4ed802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 msgr2=0x7f4ee81f7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 0x7f4ee81f7e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000c7a0 tx=0x7f4ee000cc60 comp rx=0 tx=0).stop 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 shutdown_connections 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f4ec806be30 0x7f4ec806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ee815e8e0 0x7f4ee81f7e80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee815e500 0x7f4ee81e9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 --2- 172.21.15.12:0/3906932470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ee8073cb0 0x7f4ee81e9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 >> 172.21.15.12:0/3906932470 conn(0x7f4ee8062810 msgr2=0x7f4ee80d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 shutdown_connections 2024-09-10T09:23:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.648+0000 7f4eecfbd640 1 -- 172.21.15.12:0/3906932470 wait complete. 2024-09-10T09:23:27.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T09:23:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.764+0000 7f0dd874b640 1 Processor -- start 2024-09-10T09:23:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.764+0000 7f0dd874b640 1 -- start start 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.764+0000 7f0dd874b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dd0161e30 0x7f0dd00d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd874b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0dd006dfd0 0x7f0dd00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd874b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dd00cf9a0 con 0x7f0dd00b3d50 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd874b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0dd00cfcf0 con 0x7f0dd0161e30 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd874b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0dd0162210 con 0x7f0dd006dfd0 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dd0161e30 0x7f0dd00d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dd0161e30 0x7f0dd00d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33426/0 (socket says 172.21.15.12:33426) 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd5ce6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0dd00b3d50 0x7f0dd006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46736/0 (socket says 172.21.15.12:46736) 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 -- 172.21.15.12:0/4082928552 learned_addr learned my addr 172.21.15.12:0/4082928552 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:27.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd6ce8640 1 --2- 172.21.15.12:0/4082928552 >> v2:172.21.15.100:3300/0 conn(0x7f0dd006dfd0 0x7f0dd00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 -- 172.21.15.12:0/4082928552 >> v2:172.21.15.100:3300/0 conn(0x7f0dd006dfd0 msgr2=0x7f0dd00b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 --2- 172.21.15.12:0/4082928552 >> v2:172.21.15.100:3300/0 conn(0x7f0dd006dfd0 0x7f0dd00b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 -- 172.21.15.12:0/4082928552 >> v1:172.21.15.12:6789/0 conn(0x7f0dd00b3d50 legacy=0x7f0dd006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd64e7640 1 -- 172.21.15.12:0/4082928552 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd00d5210 con 0x7f0dd0161e30 2024-09-10T09:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd54e5640 1 -- 172.21.15.12:0/4082928552 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462274497 0 0) 0x7f0dd00cf9a0 con 0x7f0dd00b3d50 2024-09-10T09:23:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.765+0000 7f0dd6ce8640 1 --2- 172.21.15.12:0/4082928552 >> v2:172.21.15.100:3300/0 conn(0x7f0dd006dfd0 0x7f0dd00b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:27.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.766+0000 7f0dd64e7640 1 --2- 172.21.15.12:0/4082928552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd0161e30 0x7f0dd00d34a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00b3ce0 tx=0x7f0dcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e2ea42b37b7996 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:27.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.766+0000 7f0dd54e5640 1 -- 172.21.15.12:0/4082928552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc037070 con 0x7f0dd0161e30 2024-09-10T09:23:27.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.766+0000 7f0dd54e5640 1 -- 172.21.15.12:0/4082928552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dcc032440 con 0x7f0dd0161e30 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.766+0000 7f0dd54e5640 1 -- 172.21.15.12:0/4082928552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc032810 con 0x7f0dd0161e30 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.766+0000 7f0dd874b640 1 -- 172.21.15.12:0/4082928552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd0161e30 msgr2=0x7f0dd00d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.766+0000 7f0dd874b640 1 --2- 172.21.15.12:0/4082928552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd0161e30 0x7f0dd00d34a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00b3ce0 tx=0x7f0dcc02a270 comp rx=0 tx=0).stop 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.767+0000 7f0dd874b640 1 -- 172.21.15.12:0/4082928552 shutdown_connections 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.767+0000 7f0dd874b640 1 --2- 172.21.15.12:0/4082928552 >> v2:172.21.15.100:3300/0 conn(0x7f0dd006dfd0 0x7f0dd00b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.767+0000 7f0dd874b640 1 --2- 172.21.15.12:0/4082928552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd0161e30 0x7f0dd00d34a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.767+0000 7f0dd874b640 1 -- 172.21.15.12:0/4082928552 >> 172.21.15.12:0/4082928552 conn(0x7f0dd00d1870 msgr2=0x7f0dd00d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.767+0000 7f0dd874b640 1 -- 172.21.15.12:0/4082928552 shutdown_connections 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.767+0000 7f0dd874b640 1 -- 172.21.15.12:0/4082928552 wait complete. 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.768+0000 7f0dd874b640 1 Processor -- start 2024-09-10T09:23:27.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.768+0000 7f0dd874b640 1 -- start start 2024-09-10T09:23:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.768+0000 7f0dd874b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 0x7f0dd0155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.768+0000 7f0dd874b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dd00b3d50 0x7f0dd00b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd874b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0dd0161e30 0x7f0dd015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd874b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd00d39e0 con 0x7f0dd006dfd0 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd874b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd00b3950 con 0x7f0dd00b3d50 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd874b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd00b59b0 con 0x7f0dd0161e30 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 0x7f0dd0155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 0x7f0dd0155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33432/0 (socket says 172.21.15.12:33432) 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 -- 172.21.15.12:0/3745261349 learned_addr learned my addr 172.21.15.12:0/3745261349 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd5ce6640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dd00b3d50 0x7f0dd00b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd6ce8640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0dd0161e30 0x7f0dd015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 -- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0dd0161e30 msgr2=0x7f0dd015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0dd0161e30 0x7f0dd015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 -- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dd00b3d50 msgr2=0x7f0dd00b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dd00b3d50 0x7f0dd00b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 -- 172.21.15.12:0/3745261349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd00b4da0 con 0x7f0dd006dfd0 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd5ce6640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dd00b3d50 0x7f0dd00b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd6ce8640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0dd0161e30 0x7f0dd015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd64e7640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 0x7f0dd0155f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc000c00 tx=0x7f0dcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc041020 con 0x7f0dd006dfd0 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0306c0 con 0x7f0dd006dfd0 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd00b5080 con 0x7f0dd006dfd0 2024-09-10T09:23:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc037040 con 0x7f0dd006dfd0 2024-09-10T09:23:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.769+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd00b5640 con 0x7f0dd006dfd0 2024-09-10T09:23:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.770+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd0161690 con 0x7f0dd006dfd0 2024-09-10T09:23:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.771+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0dcc044020 con 0x7f0dd006dfd0 2024-09-10T09:23:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.771+0000 7f0dc6ffd640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0db406be30 0x7f0db406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.772+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0dcc0ab6a0 con 0x7f0dd006dfd0 2024-09-10T09:23:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.772+0000 7f0dd5ce6640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0db406be30 0x7f0db406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.772+0000 7f0dd5ce6640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0db406be30 0x7f0db406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0160690 tx=0x7f0dc0007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.776+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0dd0161690 con 0x7f0dd006dfd0 2024-09-10T09:23:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.953+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0dd0069190 con 0x7f0dd006dfd0 2024-09-10T09:23:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.953+0000 7f0dc6ffd640 1 -- 172.21.15.12:0/3745261349 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f0dcc04b030 con 0x7f0dd006dfd0 2024-09-10T09:23:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0db406be30 msgr2=0x7f0db406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0db406be30 0x7f0db406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0160690 tx=0x7f0dc0007c10 comp rx=0 tx=0).stop 2024-09-10T09:23:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 msgr2=0x7f0dd0155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 0x7f0dd0155f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc000c00 tx=0x7f0dcc0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 shutdown_connections 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f0db406be30 0x7f0db406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0dd0161e30 0x7f0dd015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0dd00b3d50 0x7f0dd00b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 --2- 172.21.15.12:0/3745261349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd006dfd0 0x7f0dd0155f60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 >> 172.21.15.12:0/3745261349 conn(0x7f0dd00d1870 msgr2=0x7f0dd0160f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 shutdown_connections 2024-09-10T09:23:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:27.955+0000 7f0dd874b640 1 -- 172.21.15.12:0/3745261349 wait complete. 2024-09-10T09:23:27.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp94400 2024-09-10T09:23:28.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 Processor -- start 2024-09-10T09:23:28.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 -- start start 2024-09-10T09:23:28.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76bc161e30 0x7f76bc0d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76bc0b3d50 0x7f76bc06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc06de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc0cfcf0 con 0x7f76bc0b3d50 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc0cf9a0 con 0x7f76bc161e30 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.075+0000 7f76c2778640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc162210 con 0x7f76bc0b3290 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76bc0b3d50 0x7f76bc06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76bc0b3d50 0x7f76bc06d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33444/0 (socket says 172.21.15.12:33444) 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 -- 172.21.15.12:0/3444826362 learned_addr learned my addr 172.21.15.12:0/3444826362 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76c0d15640 1 --2- 172.21.15.12:0/3444826362 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc06de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bbfff640 1 --2- 172.21.15.12:0/3444826362 >> v2:172.21.15.100:3300/0 conn(0x7f76bc161e30 0x7f76bc0d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 -- 172.21.15.12:0/3444826362 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 msgr2=0x7f76bc06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 --2- 172.21.15.12:0/3444826362 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc06de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 -- 172.21.15.12:0/3444826362 >> v2:172.21.15.100:3300/0 conn(0x7f76bc161e30 msgr2=0x7f76bc0d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 --2- 172.21.15.12:0/3444826362 >> v2:172.21.15.100:3300/0 conn(0x7f76bc161e30 0x7f76bc0d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.076+0000 7f76bb7fe640 1 -- 172.21.15.12:0/3444826362 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0d5210 con 0x7f76bc0b3d50 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76bb7fe640 1 --2- 172.21.15.12:0/3444826362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc0b3d50 0x7f76bc06d8c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f76bc08dc90 tx=0x7f76b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bfc2f8c03534eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76baffd640 1 -- 172.21.15.12:0/3444826362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0037070 con 0x7f76bc0b3d50 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76baffd640 1 -- 172.21.15.12:0/3444826362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0032440 con 0x7f76bc0b3d50 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76baffd640 1 -- 172.21.15.12:0/3444826362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0032810 con 0x7f76bc0b3d50 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 -- 172.21.15.12:0/3444826362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc0b3d50 msgr2=0x7f76bc06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 --2- 172.21.15.12:0/3444826362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc0b3d50 0x7f76bc06d8c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f76bc08dc90 tx=0x7f76b002a1e0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 -- 172.21.15.12:0/3444826362 shutdown_connections 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 --2- 172.21.15.12:0/3444826362 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 --2- 172.21.15.12:0/3444826362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc0b3d50 0x7f76bc06d8c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 --2- 172.21.15.12:0/3444826362 >> v2:172.21.15.100:3300/0 conn(0x7f76bc161e30 0x7f76bc0d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 -- 172.21.15.12:0/3444826362 >> 172.21.15.12:0/3444826362 conn(0x7f76bc0d1870 msgr2=0x7f76bc0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 -- 172.21.15.12:0/3444826362 shutdown_connections 2024-09-10T09:23:28.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.077+0000 7f76c2778640 1 -- 172.21.15.12:0/3444826362 wait complete. 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.079+0000 7f76c2778640 1 Processor -- start 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.079+0000 7f76c2778640 1 -- start start 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.079+0000 7f76c2778640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc1e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.079+0000 7f76c2778640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76bc0b3d50 0x7f76bc14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.079+0000 7f76c2778640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 0x7f76bc1e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c2778640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc0d39e0 con 0x7f76bc161e30 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c2778640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc0b3950 con 0x7f76bc0b3d50 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c2778640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc0cafa0 con 0x7f76bc0b3290 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 0x7f76bc1e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 0x7f76bc1e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33458/0 (socket says 172.21.15.12:33458) 2024-09-10T09:23:28.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 -- 172.21.15.12:0/1403903525 learned_addr learned my addr 172.21.15.12:0/1403903525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76bbfff640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc1e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76bb7fe640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76bc0b3d50 0x7f76bc14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 -- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 msgr2=0x7f76bc1e7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc1e7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 -- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76bc0b3d50 msgr2=0x7f76bc14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76bc0b3d50 0x7f76bc14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 -- 172.21.15.12:0/1403903525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0c9f60 con 0x7f76bc161e30 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c0d15640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 0x7f76bc1e7160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f76b4007d70 tx=0x7f76b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4014420 con 0x7f76bc161e30 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b4019070 con 0x7f76bc161e30 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc1e76a0 con 0x7f76bc161e30 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4014820 con 0x7f76bc161e30 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.080+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc0ca4c0 con 0x7f76bc161e30 2024-09-10T09:23:28.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.081+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc0d34a0 con 0x7f76bc161e30 2024-09-10T09:23:28.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.082+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76b40149c0 con 0x7f76bc161e30 2024-09-10T09:23:28.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.082+0000 7f76b8ff9640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f76a806be30 0x7f76a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.082+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f76b408b3f0 con 0x7f76bc161e30 2024-09-10T09:23:28.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.083+0000 7f76bbfff640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f76a806be30 0x7f76a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.083+0000 7f76bbfff640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f76a806be30 0x7f76a806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76ac006fd0 tx=0x7f76ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.087+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76bc0c9f60 con 0x7f76bc161e30 2024-09-10T09:23:28.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.288+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f76bc160120 con 0x7f76a806be30 2024-09-10T09:23:28.294 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:28.294+0000 7ff0f2af1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:28.294 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:28.294+0000 7ff0f2af1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:28.294 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:28.294+0000 7ff0f2af1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:28.294 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:28.294+0000 7ff0f2af1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:28.294 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:28.294+0000 7ff0f2af1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:28.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.309+0000 7f76b8ff9640 1 -- 172.21.15.12:0/1403903525 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f76bc160120 con 0x7f76a806be30 2024-09-10T09:23:28.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f76a806be30 msgr2=0x7f76a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f76a806be30 0x7f76a806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76ac006fd0 tx=0x7f76ac008040 comp rx=0 tx=0).stop 2024-09-10T09:23:28.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 msgr2=0x7f76bc1e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 0x7f76bc1e7160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f76b4007d70 tx=0x7f76b400e4b0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 shutdown_connections 2024-09-10T09:23:28.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f76a806be30 0x7f76a806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76bc161e30 0x7f76bc1e7160 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76bc0b3d50 0x7f76bc14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 --2- 172.21.15.12:0/1403903525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76bc0b3290 0x7f76bc1e7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 >> 172.21.15.12:0/1403903525 conn(0x7f76bc0d1870 msgr2=0x7f76bc0b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:28.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 shutdown_connections 2024-09-10T09:23:28.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.311+0000 7f76c2778640 1 -- 172.21.15.12:0/1403903525 wait complete. 2024-09-10T09:23:28.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol39540 --group_name subvol_grp94400 2024-09-10T09:23:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.430+0000 7f15eb85a640 1 Processor -- start 2024-09-10T09:23:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.431+0000 7f15eb85a640 1 -- start start 2024-09-10T09:23:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.431+0000 7f15eb85a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.431+0000 7f15eb85a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15e40b3b00 0x7f15e41625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.431+0000 7f15eb85a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e40b6b00 con 0x7f15e40b3540 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.431+0000 7f15eb85a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f15e40d24f0 con 0x7f15e40b3b00 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.431+0000 7f15eb85a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f15e40d20e0 con 0x7f15e40b61e0 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15e40b3b00 0x7f15e41625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15e40b3b00 0x7f15e41625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33466/0 (socket says 172.21.15.12:33466) 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 -- 172.21.15.12:0/1817005783 learned_addr learned my addr 172.21.15.12:0/1817005783 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 -- 172.21.15.12:0/1817005783 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 msgr2=0x7f15e40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 --2- 172.21.15.12:0/1817005783 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 -- 172.21.15.12:0/1817005783 >> v1:172.21.15.100:6789/0 conn(0x7f15e40b3540 legacy=0x7f15e4162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.432+0000 7f15e8df5640 1 -- 172.21.15.12:0/1817005783 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e40cfa70 con 0x7f15e40b3b00 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15e8df5640 1 --2- 172.21.15.12:0/1817005783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e41625d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009e50 tx=0x7f15d802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd1b12e024b23e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15e3fff640 1 -- 172.21.15.12:0/1817005783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8036070 con 0x7f15e40b3b00 2024-09-10T09:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15e3fff640 1 -- 172.21.15.12:0/1817005783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d8031600 con 0x7f15e40b3b00 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15e3fff640 1 -- 172.21.15.12:0/1817005783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d80319d0 con 0x7f15e40b3b00 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15eb85a640 1 -- 172.21.15.12:0/1817005783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 msgr2=0x7f15e41625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1817005783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e41625d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009e50 tx=0x7f15d802a5b0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15eb85a640 1 -- 172.21.15.12:0/1817005783 shutdown_connections 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1817005783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e41625d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1817005783 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.433+0000 7f15eb85a640 1 -- 172.21.15.12:0/1817005783 >> 172.21.15.12:0/1817005783 conn(0x7f15e40d11e0 msgr2=0x7f15e40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.434+0000 7f15eb85a640 1 -- 172.21.15.12:0/1817005783 shutdown_connections 2024-09-10T09:23:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.434+0000 7f15eb85a640 1 -- 172.21.15.12:0/1817005783 wait complete. 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.435+0000 7f15eb85a640 1 Processor -- start 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.435+0000 7f15eb85a640 1 -- start start 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.435+0000 7f15eb85a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40b3540 0x7f15e40d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15eb85a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15eb85a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15eb85a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15e415edc0 con 0x7f15e40b3b00 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15eb85a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15e40d0030 con 0x7f15e40b3540 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15eb85a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f15e40ab580 con 0x7f15e40b61e0 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e415b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33476/0 (socket says 172.21.15.12:33476) 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 -- 172.21.15.12:0/1203281682 learned_addr learned my addr 172.21.15.12:0/1203281682 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e95f6640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40b3540 0x7f15e40d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e9df7640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 -- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 msgr2=0x7f15e40b8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 -- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40b3540 msgr2=0x7f15e40d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40b3540 0x7f15e40d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 -- 172.21.15.12:0/1203281682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e40b2b50 con 0x7f15e40b3b00 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e8df5640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e415b9b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f15d8034040 tx=0x7f15d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8041020 con 0x7f15e40b3b00 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d8007800 con 0x7f15e40b3b00 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e40b2e30 con 0x7f15e40b3b00 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.436+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8036040 con 0x7f15e40b3b00 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.437+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e415c1f0 con 0x7f15e40b3b00 2024-09-10T09:23:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.438+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e40d1d00 con 0x7f15e40b3b00 2024-09-10T09:23:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.438+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15d8044020 con 0x7f15e40b3b00 2024-09-10T09:23:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.438+0000 7f15e1ffb640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15d006be30 0x7f15d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.439+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f15d80abad0 con 0x7f15e40b3b00 2024-09-10T09:23:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.439+0000 7f15e95f6640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15d006be30 0x7f15d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.439+0000 7f15e95f6640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15d006be30 0x7f15d006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098e0 tx=0x7f15d4009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.443+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15d804b030 con 0x7f15e40b3b00 2024-09-10T09:23:28.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.642+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol39540", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f15e40ba6e0 con 0x7f15d006be30 2024-09-10T09:23:28.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.670+0000 7f15e1ffb640 1 -- 172.21.15.12:0/1203281682 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f15e40ba6e0 con 0x7f15d006be30 2024-09-10T09:23:28.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.672+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15d006be30 msgr2=0x7f15d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.672+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15d006be30 0x7f15d006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098e0 tx=0x7f15d4009060 comp rx=0 tx=0).stop 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.672+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 msgr2=0x7f15e415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.672+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e415b9b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f15d8034040 tx=0x7f15d8004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 shutdown_connections 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f15d006be30 0x7f15d006e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15e40b61e0 0x7f15e40b8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e40b3b00 0x7f15e415b9b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 --2- 172.21.15.12:0/1203281682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15e40b3540 0x7f15e40d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 >> 172.21.15.12:0/1203281682 conn(0x7f15e40d11e0 msgr2=0x7f15e415d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 shutdown_connections 2024-09-10T09:23:28.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.673+0000 7f15eb85a640 1 -- 172.21.15.12:0/1203281682 wait complete. 2024-09-10T09:23:28.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol84121 --group_name subvol_grp94400 2024-09-10T09:23:28.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 Processor -- start 2024-09-10T09:23:28.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 -- start start 2024-09-10T09:23:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f4c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1f4c0b3b00 0x7f1f4c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c0b6b00 con 0x7f1f4c0b3540 2024-09-10T09:23:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1f4c0d24f0 con 0x7f1f4c0b3b00 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.792+0000 7f1f5235f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c0d20e0 con 0x7f1f4c0b61e0 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f508fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f4c0b3540 0x7f1f4c162b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46738/0 (socket says 172.21.15.12:46738) 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f508fc640 1 -- 172.21.15.12:0/1854188555 learned_addr learned my addr 172.21.15.12:0/1854188555 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f43fff640 1 --2- 172.21.15.12:0/1854188555 >> v2:172.21.15.100:3300/0 conn(0x7f1f4c0b3b00 0x7f1f4c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f4c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271599840 0 0) 0x7f1f4c0b6b00 con 0x7f1f4c0b3540 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f38003520 con 0x7f1f4c0b3540 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3842143955 0 0) 0x7f1f38003520 con 0x7f1f4c0b3540 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 msgr2=0x7f1f4c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f4c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 >> v2:172.21.15.100:3300/0 conn(0x7f1f4c0b3b00 msgr2=0x7f1f4c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 --2- 172.21.15.12:0/1854188555 >> v2:172.21.15.100:3300/0 conn(0x7f1f4c0b3b00 0x7f1f4c1625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c0cfa70 con 0x7f1f4c0b3540 2024-09-10T09:23:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f1f440019f0 con 0x7f1f4c0b3540 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 >> v1:172.21.15.12:6789/0 conn(0x7f1f4c0b3540 legacy=0x7f1f4c162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f380039b0 0x7f1f38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f38004800 0x7f1f38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c0d24f0 con 0x7f1f38004800 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c0d20e0 con 0x7f1f380039b0 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3800ba40 con 0x7f1f4c0b61e0 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f43fff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f38004800 0x7f1f38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f380039b0 0x7f1f38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.793+0000 7f1f508fc640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f4bfff640 1 -- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 msgr2=0x7f1f380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f4bfff640 1 -- 172.21.15.12:0/1854188555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f38004800 msgr2=0x7f1f38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f38004800 0x7f1f38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f4bfff640 1 -- 172.21.15.12:0/1854188555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38003520 con 0x7f1f380039b0 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f43fff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f38004800 0x7f1f38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f508fc640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f4c0b61e0 0x7f1f380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.794+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f380039b0 0x7f1f38003dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009aa0 tx=0x7f1f38005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3edc3268d9731121 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c036070 con 0x7f1f380039b0 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c031400 con 0x7f1f380039b0 2024-09-10T09:23:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f4b7fe640 1 -- 172.21.15.12:0/1854188555 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c009670 con 0x7f1f380039b0 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f5235f640 1 -- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f380039b0 msgr2=0x7f1f38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f5235f640 1 --2- 172.21.15.12:0/1854188555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f380039b0 0x7f1f38003dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009aa0 tx=0x7f1f38005830 comp rx=0 tx=0).stop 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f508fc640 1 -- 172.21.15.12:0/1854188555 reap_dead start 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f5235f640 1 -- 172.21.15.12:0/1854188555 shutdown_connections 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f5235f640 1 -- 172.21.15.12:0/1854188555 >> 172.21.15.12:0/1854188555 conn(0x7f1f4c0d11e0 msgr2=0x7f1f4c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f5235f640 1 -- 172.21.15.12:0/1854188555 shutdown_connections 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.795+0000 7f1f5235f640 1 -- 172.21.15.12:0/1854188555 wait complete. 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.796+0000 7f1f5235f640 1 Processor -- start 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 -- start start 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f380039b0 0x7f1f4c0ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f4c162850 0x7f1f4c14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 0x7f1f4c14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15edc0 con 0x7f1f4c14ab80 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c0d0030 con 0x7f1f4c162850 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f5235f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c15e560 con 0x7f1f380039b0 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f508fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 0x7f1f4c14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f43fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f4c162850 0x7f1f4c14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f508fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 0x7f1f4c14b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33486/0 (socket says 172.21.15.12:33486) 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f508fc640 1 -- 172.21.15.12:0/2527670407 learned_addr learned my addr 172.21.15.12:0/2527670407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.797+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f380039b0 0x7f1f4c0ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f508fc640 1 -- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f380039b0 msgr2=0x7f1f4c0ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f508fc640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f380039b0 0x7f1f4c0ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f508fc640 1 -- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f4c162850 msgr2=0x7f1f4c14c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f508fc640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f4c162850 0x7f1f4c14c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f508fc640 1 -- 172.21.15.12:0/2527670407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c14b6c0 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f380039b0 0x7f1f4c0ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f43fff640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f4c162850 0x7f1f4c14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f508fc640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 0x7f1f4c14b000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000f80 tx=0x7f1f4400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34009690 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f44018070 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c14b9a0 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400edb0 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.798+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c14bf60 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.799+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4c0ba6e0 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.800+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f4401d460 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.800+0000 7f1f497fa640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1f2c06be30 0x7f1f2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.800+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1f4408aeb0 con 0x7f1f4c14ab80 2024-09-10T09:23:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.801+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1f2c06be30 0x7f1f2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.801+0000 7f1f4bfff640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1f2c06be30 0x7f1f2c06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c033000 tx=0x7f1f3c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:28.805+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f44059860 con 0x7f1f4c14ab80 2024-09-10T09:23:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.005+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol84121", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f1f4c162e20 con 0x7f1f2c06be30 2024-09-10T09:23:29.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.031+0000 7f1f497fa640 1 -- 172.21.15.12:0/2527670407 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f4c162e20 con 0x7f1f2c06be30 2024-09-10T09:23:29.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1f2c06be30 msgr2=0x7f1f2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1f2c06be30 0x7f1f2c06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c033000 tx=0x7f1f3c008030 comp rx=0 tx=0).stop 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 msgr2=0x7f1f4c14b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 0x7f1f4c14b000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000f80 tx=0x7f1f4400e530 comp rx=0 tx=0).stop 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 shutdown_connections 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1f2c06be30 0x7f1f2c06e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f4c14ab80 0x7f1f4c14b000 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f4c162850 0x7f1f4c14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 --2- 172.21.15.12:0/2527670407 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1f380039b0 0x7f1f4c0ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 >> 172.21.15.12:0/2527670407 conn(0x7f1f4c0d11e0 msgr2=0x7f1f4c0d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 shutdown_connections 2024-09-10T09:23:29.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.033+0000 7f1f5235f640 1 -- 172.21.15.12:0/2527670407 wait complete. 2024-09-10T09:23:29.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol3162 --group_name subvol_grp94400 2024-09-10T09:23:29.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.153+0000 7f36fdda2640 1 Processor -- start 2024-09-10T09:23:29.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.153+0000 7f36fdda2640 1 -- start start 2024-09-10T09:23:29.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36fdda2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36f80d28b0 0x7f36f8167050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36fdda2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80d1ac0 con 0x7f36f80b6ff0 2024-09-10T09:23:29.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36fdda2640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80b5500 con 0x7f36f815c4a0 2024-09-10T09:23:29.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36fdda2640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f36f80b57e0 con 0x7f36f80d28b0 2024-09-10T09:23:29.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f7fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f36f80b6ff0 0x7f36f80cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46746/0 (socket says 172.21.15.12:46746) 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f7fff640 1 -- 172.21.15.12:0/639963878 learned_addr learned my addr 172.21.15.12:0/639963878 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36fd5a1640 1 --2- 172.21.15.12:0/639963878 >> v2:172.21.15.100:3300/0 conn(0x7f36f80d28b0 0x7f36f8167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165901583 0 0) 0x7f36f80d1ac0 con 0x7f36f80b6ff0 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36e4003520 con 0x7f36f80b6ff0 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3780019318 0 0) 0x7f36e4003520 con 0x7f36f80b6ff0 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 >> v2:172.21.15.100:3300/0 conn(0x7f36f80d28b0 msgr2=0x7f36f8167050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 --2- 172.21.15.12:0/639963878 >> v2:172.21.15.100:3300/0 conn(0x7f36f80d28b0 0x7f36f8167050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 >> v1:172.21.15.100:6789/0 conn(0x7f36f815c4a0 legacy=0x7f36f80d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80b5ac0 con 0x7f36f80b6ff0 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f36e00019f0 con 0x7f36f80b6ff0 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 >> v1:172.21.15.12:6789/0 conn(0x7f36f80b6ff0 legacy=0x7f36f80cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36e40051c0 0x7f36e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80b57e0 con 0x7f36e4004800 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36e400c060 con 0x7f36e40039b0 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f36e400c260 con 0x7f36e40051c0 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36f7fff640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.154+0000 7f36fcda0640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fd5a1640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36e40051c0 0x7f36e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fcda0640 1 -- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36e40051c0 msgr2=0x7f36e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fcda0640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36e40051c0 0x7f36e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fcda0640 1 -- 172.21.15.12:0/639963878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36e4004800 msgr2=0x7f36e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fcda0640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fcda0640 1 -- 172.21.15.12:0/639963878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e4003520 con 0x7f36e40039b0 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.155+0000 7f36fd5a1640 1 -- 172.21.15.12:0/639963878 reap_dead start 2024-09-10T09:23:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fcda0640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36e4003dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f36e8001750 tx=0x7f36e4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=109680534f2c254e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8001370 con 0x7f36e40039b0 2024-09-10T09:23:29.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e80052d0 con 0x7f36e40039b0 2024-09-10T09:23:29.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36f77fe640 1 -- 172.21.15.12:0/639963878 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e802abe0 con 0x7f36e40039b0 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 -- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 msgr2=0x7f36e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36e4003dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f36e8001750 tx=0x7f36e4005830 comp rx=0 tx=0).stop 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 -- 172.21.15.12:0/639963878 shutdown_connections 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 --2- 172.21.15.12:0/639963878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36e4003dd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 -- 172.21.15.12:0/639963878 >> 172.21.15.12:0/639963878 conn(0x7f36f806f390 msgr2=0x7f36f806f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 -- 172.21.15.12:0/639963878 shutdown_connections 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.156+0000 7f36fdda2640 1 -- 172.21.15.12:0/639963878 wait complete. 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.157+0000 7f36fdda2640 1 Processor -- start 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 -- start start 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36f81537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36f80cc190 0x7f36f81f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 0x7f36f80b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80d21a0 con 0x7f36f81564e0 2024-09-10T09:23:29.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36f815c880 con 0x7f36e40039b0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.158+0000 7f36fdda2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80d2320 con 0x7f36f80cc190 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 0x7f36f80b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 0x7f36f80b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33512/0 (socket says 172.21.15.12:33512) 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 -- 172.21.15.12:0/1494092429 learned_addr learned my addr 172.21.15.12:0/1494092429 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fcda0640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36f81537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36f7fff640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36f80cc190 0x7f36f81f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 -- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36f80cc190 msgr2=0x7f36f81f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36f80cc190 0x7f36f81f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 -- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 msgr2=0x7f36f81537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36f81537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 -- 172.21.15.12:0/1494092429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f81541f0 con 0x7f36f81564e0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fd5a1640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 0x7f36f80b4040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36f80b84f0 tx=0x7f36f0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0019020 con 0x7f36f81564e0 2024-09-10T09:23:29.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f0004240 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f81544d0 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003610 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.159+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81f1e00 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.160+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f81f1bf0 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.161+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36f001c020 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.161+0000 7f36f57fa640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f36d806be30 0x7f36d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.161+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f36f008ae80 con 0x7f36f81564e0 2024-09-10T09:23:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.162+0000 7f36fcda0640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f36d806be30 0x7f36d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.162+0000 7f36fcda0640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f36d806be30 0x7f36d806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36e8032000 tx=0x7f36e802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.166+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36f0023020 con 0x7f36f81564e0 2024-09-10T09:23:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.313+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f36f0012040 con 0x7f36f81564e0 2024-09-10T09:23:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.369+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol3162", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f36f81549f0 con 0x7f36d806be30 2024-09-10T09:23:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.394+0000 7f36f57fa640 1 -- 172.21.15.12:0/1494092429 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f36f81549f0 con 0x7f36d806be30 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f36d806be30 msgr2=0x7f36d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f36d806be30 0x7f36d806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36e8032000 tx=0x7f36e802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 msgr2=0x7f36f80b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 0x7f36f80b4040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36f80b84f0 tx=0x7f36f0011a20 comp rx=0 tx=0).stop 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 shutdown_connections 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f36d806be30 0x7f36d806e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f81564e0 0x7f36f80b4040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36f80cc190 0x7f36f81f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 --2- 172.21.15.12:0/1494092429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36e40039b0 0x7f36f81537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 >> 172.21.15.12:0/1494092429 conn(0x7f36f806f390 msgr2=0x7f36f80d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:29.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 shutdown_connections 2024-09-10T09:23:29.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.396+0000 7f36fdda2640 1 -- 172.21.15.12:0/1494092429 wait complete. 2024-09-10T09:23:29.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol39540 subvol_grp94400 2024-09-10T09:23:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.513+0000 7f93820f1640 1 Processor -- start 2024-09-10T09:23:29.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.513+0000 7f93820f1640 1 -- start start 2024-09-10T09:23:29.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f93820f1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f937c0b61e0 0x7f937c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f93820f1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f937c0b3b00 0x7f937c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f93820f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3540 0x7f937c162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f93820f1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f937c0d24f0 con 0x7f937c0b61e0 2024-09-10T09:23:29.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f93820f1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f937c0b6b00 con 0x7f937c0b3b00 2024-09-10T09:23:29.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f93820f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f937c0d20e0 con 0x7f937c0b3540 2024-09-10T09:23:29.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f937b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f937c0b61e0 0x7f937c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f937b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f937c0b61e0 0x7f937c0b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33520/0 (socket says 172.21.15.12:33520) 2024-09-10T09:23:29.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.514+0000 7f937b7fe640 1 -- 172.21.15.12:0/1754674782 learned_addr learned my addr 172.21.15.12:0/1754674782 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:29.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937affd640 1 --2- 172.21.15.12:0/1754674782 >> v2:172.21.15.100:3300/0 conn(0x7f937c0b3b00 0x7f937c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937bfff640 1 --2- 172.21.15.12:0/1754674782 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3540 0x7f937c162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937b7fe640 1 -- 172.21.15.12:0/1754674782 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3540 msgr2=0x7f937c162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937b7fe640 1 --2- 172.21.15.12:0/1754674782 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3540 0x7f937c162b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937b7fe640 1 -- 172.21.15.12:0/1754674782 >> v2:172.21.15.100:3300/0 conn(0x7f937c0b3b00 msgr2=0x7f937c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937b7fe640 1 --2- 172.21.15.12:0/1754674782 >> v2:172.21.15.100:3300/0 conn(0x7f937c0b3b00 0x7f937c1625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937b7fe640 1 -- 172.21.15.12:0/1754674782 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c0cfa70 con 0x7f937c0b61e0 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937affd640 1 --2- 172.21.15.12:0/1754674782 >> v2:172.21.15.100:3300/0 conn(0x7f937c0b3b00 0x7f937c1625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.515+0000 7f937b7fe640 1 --2- 172.21.15.12:0/1754674782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b61e0 0x7f937c0b65c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f937c163690 tx=0x7f936c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120674de83ac7b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f937a7fc640 1 -- 172.21.15.12:0/1754674782 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c037070 con 0x7f937c0b61e0 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f937a7fc640 1 -- 172.21.15.12:0/1754674782 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c02ae00 con 0x7f937c0b61e0 2024-09-10T09:23:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f937a7fc640 1 -- 172.21.15.12:0/1754674782 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c032660 con 0x7f937c0b61e0 2024-09-10T09:23:29.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 -- 172.21.15.12:0/1754674782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b61e0 msgr2=0x7f937c0b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 --2- 172.21.15.12:0/1754674782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b61e0 0x7f937c0b65c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f937c163690 tx=0x7f936c02a0b0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 -- 172.21.15.12:0/1754674782 shutdown_connections 2024-09-10T09:23:29.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 --2- 172.21.15.12:0/1754674782 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3540 0x7f937c162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 --2- 172.21.15.12:0/1754674782 >> v2:172.21.15.100:3300/0 conn(0x7f937c0b3b00 0x7f937c1625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 --2- 172.21.15.12:0/1754674782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b61e0 0x7f937c0b65c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 -- 172.21.15.12:0/1754674782 >> 172.21.15.12:0/1754674782 conn(0x7f937c0d11e0 msgr2=0x7f937c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 -- 172.21.15.12:0/1754674782 shutdown_connections 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.516+0000 7f93820f1640 1 -- 172.21.15.12:0/1754674782 wait complete. 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.517+0000 7f93820f1640 1 Processor -- start 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 -- start start 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 0x7f937c0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3b00 0x7f937c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f937c0b61e0 0x7f937c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f937c15edc0 con 0x7f937c0b3540 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f937c0d0030 con 0x7f937c0b61e0 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f93820f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f937c0ccab0 con 0x7f937c0b3b00 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.518+0000 7f937b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 0x7f937c0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 0x7f937c0cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33536/0 (socket says 172.21.15.12:33536) 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 -- 172.21.15.12:0/2515630444 learned_addr learned my addr 172.21.15.12:0/2515630444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937affd640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3b00 0x7f937c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937bfff640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f937c0b61e0 0x7f937c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 -- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3b00 msgr2=0x7f937c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3b00 0x7f937c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 -- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f937c0b61e0 msgr2=0x7f937c14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f937c0b61e0 0x7f937c14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 -- 172.21.15.12:0/2515630444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c14d4b0 con 0x7f937c0b3540 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f937b7fe640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 0x7f937c0cd9f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f936c0097c0 tx=0x7f936c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c041070 con 0x7f937c0b3540 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c03c670 con 0x7f937c0b3540 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937c14d790 con 0x7f937c0b3540 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c037040 con 0x7f937c0b3540 2024-09-10T09:23:29.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.519+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f937c0cc720 con 0x7f937c0b3540 2024-09-10T09:23:29.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.520+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937c0d1d00 con 0x7f937c0b3540 2024-09-10T09:23:29.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.521+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f936c03a070 con 0x7f937c0b3540 2024-09-10T09:23:29.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.521+0000 7f9363fff640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f936806bec0 0x7f936806e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.521+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f936c0aadd0 con 0x7f937c0b3540 2024-09-10T09:23:29.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.521+0000 7f937affd640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f936806bec0 0x7f936806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.522+0000 7f937affd640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f936806bec0 0x7f936806e380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f937c1e9680 tx=0x7f9370008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.526+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f936c0790b0 con 0x7f937c0b3540 2024-09-10T09:23:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.725+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol39540", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f937c0ba6e0 con 0x7f936806bec0 2024-09-10T09:23:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.737+0000 7f9363fff640 1 -- 172.21.15.12:0/2515630444 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f937c0ba6e0 con 0x7f936806bec0 2024-09-10T09:23:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f936806bec0 msgr2=0x7f936806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f936806bec0 0x7f936806e380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f937c1e9680 tx=0x7f9370008040 comp rx=0 tx=0).stop 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 msgr2=0x7f937c0cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 0x7f937c0cd9f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f936c0097c0 tx=0x7f936c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 shutdown_connections 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f936806bec0 0x7f936806e380 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f937c0b61e0 0x7f937c14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f937c0b3b00 0x7f937c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 --2- 172.21.15.12:0/2515630444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f937c0b3540 0x7f937c0cd9f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 >> 172.21.15.12:0/2515630444 conn(0x7f937c0d11e0 msgr2=0x7f937c0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 shutdown_connections 2024-09-10T09:23:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.739+0000 7f93820f1640 1 -- 172.21.15.12:0/2515630444 wait complete. 2024-09-10T09:23:29.741 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.741+0000 7ff0f5af7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.741 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.741+0000 7ff0f5af7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.741 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.741+0000 7ff0f5af7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.741 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.741+0000 7ff0f5af7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.741 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.741+0000 7ff0f5af7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.751 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol84121 subvol_grp94400 2024-09-10T09:23:29.756 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.755+0000 7ff0f52f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.756 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.755+0000 7ff0f52f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.756 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.755+0000 7ff0f52f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.756 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.755+0000 7ff0f52f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.756 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-09-10T09:23:29.755+0000 7ff0f52f6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T09:23:29.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.856+0000 7f65e6253640 1 Processor -- start 2024-09-10T09:23:29.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.856+0000 7f65e6253640 1 -- start start 2024-09-10T09:23:29.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65e6253640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3b00 0x7f65e00d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65e6253640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65e00b3540 0x7f65e00d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65e6253640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e00d20e0 con 0x7f65e00b61e0 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65e6253640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f65e00d24f0 con 0x7f65e00b3540 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65e6253640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f65e00cfa70 con 0x7f65e00b3b00 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65dffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65e00b3540 0x7f65e00d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65dffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65e00b3540 0x7f65e00d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33546/0 (socket says 172.21.15.12:33546) 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.857+0000 7f65dffff640 1 -- 172.21.15.12:0/3528063191 learned_addr learned my addr 172.21.15.12:0/3528063191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.858+0000 7f65deffd640 1 --2- 172.21.15.12:0/3528063191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3b00 0x7f65e00d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.858+0000 7f65dffff640 1 -- 172.21.15.12:0/3528063191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3b00 msgr2=0x7f65e00d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.858+0000 7f65dffff640 1 --2- 172.21.15.12:0/3528063191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3b00 0x7f65e00d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.858+0000 7f65dffff640 1 -- 172.21.15.12:0/3528063191 >> v1:172.21.15.100:6789/0 conn(0x7f65e00b61e0 legacy=0x7f65e00b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.858+0000 7f65dffff640 1 -- 172.21.15.12:0/3528063191 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e00cfd50 con 0x7f65e00b3540 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.859+0000 7f65dffff640 1 --2- 172.21.15.12:0/3528063191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3540 0x7f65e00d2ec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009e50 tx=0x7f65d802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe4e5cdd9c339ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.859+0000 7f65de7fc640 1 -- 172.21.15.12:0/3528063191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8036070 con 0x7f65e00b3540 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.859+0000 7f65de7fc640 1 -- 172.21.15.12:0/3528063191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d8031600 con 0x7f65e00b3540 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.859+0000 7f65de7fc640 1 -- 172.21.15.12:0/3528063191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80319d0 con 0x7f65e00b3540 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 -- 172.21.15.12:0/3528063191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3540 msgr2=0x7f65e00d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 --2- 172.21.15.12:0/3528063191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3540 0x7f65e00d2ec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009e50 tx=0x7f65d802a5f0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 -- 172.21.15.12:0/3528063191 shutdown_connections 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 --2- 172.21.15.12:0/3528063191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3540 0x7f65e00d2ec0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 --2- 172.21.15.12:0/3528063191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3b00 0x7f65e00d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 -- 172.21.15.12:0/3528063191 >> 172.21.15.12:0/3528063191 conn(0x7f65e00d11e0 msgr2=0x7f65e00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 -- 172.21.15.12:0/3528063191 shutdown_connections 2024-09-10T09:23:29.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.860+0000 7f65e6253640 1 -- 172.21.15.12:0/3528063191 wait complete. 2024-09-10T09:23:29.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.861+0000 7f65e6253640 1 Processor -- start 2024-09-10T09:23:29.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.861+0000 7f65e6253640 1 -- start start 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65e6253640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3540 0x7f65e015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65e6253640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 0x7f65e0161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65e6253640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e00b61e0 0x7f65e015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65e6253640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65e015edc0 con 0x7f65e00b3b00 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65e6253640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65e00d1d00 con 0x7f65e00b61e0 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65e6253640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f65e015c5b0 con 0x7f65e00b3540 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 0x7f65e0161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 0x7f65e0161ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33562/0 (socket says 172.21.15.12:33562) 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 -- 172.21.15.12:0/625831441 learned_addr learned my addr 172.21.15.12:0/625831441 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65dffff640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e00b61e0 0x7f65e015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65df7fe640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3540 0x7f65e015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 -- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3540 msgr2=0x7f65e015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3540 0x7f65e015c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 -- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e00b61e0 msgr2=0x7f65e015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e00b61e0 0x7f65e015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.862+0000 7f65deffd640 1 -- 172.21.15.12:0/625831441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e0161880 con 0x7f65e00b3b00 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.863+0000 7f65deffd640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 0x7f65e0161ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65d400d5d0 tx=0x7f65d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.863+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40125f0 con 0x7f65e00b3b00 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.863+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4019070 con 0x7f65e00b3b00 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.863+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e01612c0 con 0x7f65e00b3b00 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.863+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40129d0 con 0x7f65e00b3b00 2024-09-10T09:23:29.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.863+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e00cc370 con 0x7f65e00b3b00 2024-09-10T09:23:29.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.864+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e00b65c0 con 0x7f65e00b3b00 2024-09-10T09:23:29.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.864+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f65d4012b70 con 0x7f65e00b3b00 2024-09-10T09:23:29.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.865+0000 7f65c7fff640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65cc06bec0 0x7f65cc06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:29.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.865+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f65d408b0c0 con 0x7f65e00b3b00 2024-09-10T09:23:29.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.865+0000 7f65df7fe640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65cc06bec0 0x7f65cc06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:29.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.866+0000 7f65df7fe640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65cc06bec0 0x7f65cc06e380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65e00d4000 tx=0x7f65d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:29.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:29.869+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65d40594c0 con 0x7f65e00b3b00 2024-09-10T09:23:30.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.068+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol84121", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f65e00ba6e0 con 0x7f65cc06bec0 2024-09-10T09:23:30.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.089+0000 7f65c7fff640 1 -- 172.21.15.12:0/625831441 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f65e00ba6e0 con 0x7f65cc06bec0 2024-09-10T09:23:30.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.091+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65cc06bec0 msgr2=0x7f65cc06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.091+0000 7f65e6253640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65cc06bec0 0x7f65cc06e380 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65e00d4000 tx=0x7f65d0009040 comp rx=0 tx=0).stop 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.091+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 msgr2=0x7f65e0161ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.091+0000 7f65e6253640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 0x7f65e0161ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65d400d5d0 tx=0x7f65d400da90 comp rx=0 tx=0).stop 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.091+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 shutdown_connections 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f65cc06bec0 0x7f65cc06e380 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e00b61e0 0x7f65e015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e00b3b00 0x7f65e0161ab0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 --2- 172.21.15.12:0/625831441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65e00b3540 0x7f65e015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 >> 172.21.15.12:0/625831441 conn(0x7f65e00d11e0 msgr2=0x7f65e00b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 shutdown_connections 2024-09-10T09:23:30.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.092+0000 7f65e6253640 1 -- 172.21.15.12:0/625831441 wait complete. 2024-09-10T09:23:30.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol3162 subvol_grp94400 2024-09-10T09:23:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.210+0000 7f6ccca74640 1 Processor -- start 2024-09-10T09:23:30.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.210+0000 7f6ccca74640 1 -- start start 2024-09-10T09:23:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6ccca74640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6ccca74640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cc8070d30 0x7f6cc80b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6ccca74640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cc80d24f0 0x7f6cc80d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6ccca74640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc80b5be0 con 0x7f6cc8070d30 2024-09-10T09:23:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6ccca74640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc806e5d0 con 0x7f6cc80d24f0 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6ccca74640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc80d2ea0 con 0x7f6cc815eb10 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cc8070d30 0x7f6cc80b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6cc8070d30 0x7f6cc80b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33564/0 (socket says 172.21.15.12:33564) 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/2527630313 learned_addr learned my addr 172.21.15.12:0/2527630313 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cc6d9d640 1 --2- 172.21.15.12:0/2527630313 >> v2:172.21.15.100:3300/0 conn(0x7f6cc80d24f0 0x7f6cc80d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cc659c640 1 --2- 172.21.15.12:0/2527630313 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/2527630313 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 msgr2=0x7f6cc806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:30.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 --2- 172.21.15.12:0/2527630313 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/2527630313 >> v2:172.21.15.100:3300/0 conn(0x7f6cc80d24f0 msgr2=0x7f6cc80d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:30.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 --2- 172.21.15.12:0/2527630313 >> v2:172.21.15.100:3300/0 conn(0x7f6cc80d24f0 0x7f6cc80d2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.211+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/2527630313 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc8071170 con 0x7f6cc8070d30 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.212+0000 7f6cbdd9b640 1 --2- 172.21.15.12:0/2527630313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc8070d30 0x7f6cc80b56a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80d3180 tx=0x7f6cb002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670439417086c359 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.212+0000 7f6cc5d9b640 1 -- 172.21.15.12:0/2527630313 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0037070 con 0x7f6cc8070d30 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.212+0000 7f6cc5d9b640 1 -- 172.21.15.12:0/2527630313 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0032440 con 0x7f6cc8070d30 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.212+0000 7f6cc5d9b640 1 -- 172.21.15.12:0/2527630313 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0032810 con 0x7f6cc8070d30 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 -- 172.21.15.12:0/2527630313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc8070d30 msgr2=0x7f6cc80b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 --2- 172.21.15.12:0/2527630313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc8070d30 0x7f6cc80b56a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80d3180 tx=0x7f6cb002a1e0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 -- 172.21.15.12:0/2527630313 shutdown_connections 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 --2- 172.21.15.12:0/2527630313 >> v2:172.21.15.100:3300/0 conn(0x7f6cc80d24f0 0x7f6cc80d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 --2- 172.21.15.12:0/2527630313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc8070d30 0x7f6cc80b56a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 --2- 172.21.15.12:0/2527630313 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 -- 172.21.15.12:0/2527630313 >> 172.21.15.12:0/2527630313 conn(0x7f6cc806f370 msgr2=0x7f6cc806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:30.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 -- 172.21.15.12:0/2527630313 shutdown_connections 2024-09-10T09:23:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.213+0000 7f6ccca74640 1 -- 172.21.15.12:0/2527630313 wait complete. 2024-09-10T09:23:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.214+0000 7f6ccca74640 1 Processor -- start 2024-09-10T09:23:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.214+0000 7f6ccca74640 1 -- start start 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6ccca74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc8070d30 0x7f6cc813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6ccca74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 0x7f6cc81f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6ccca74640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc81615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6ccca74640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc806e820 con 0x7f6cc80d24f0 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6ccca74640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc8071a40 con 0x7f6cc8070d30 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6ccca74640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc806eb00 con 0x7f6cc815eb10 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 0x7f6cc81f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 0x7f6cc81f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33580/0 (socket says 172.21.15.12:33580) 2024-09-10T09:23:30.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/3195980658 learned_addr learned my addr 172.21.15.12:0/3195980658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cc659c640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc8070d30 0x7f6cc813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cc6d9d640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc81615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 msgr2=0x7f6cc81615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc81615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc8070d30 msgr2=0x7f6cc813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc8070d30 0x7f6cc813fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.215+0000 7f6cbdd9b640 1 -- 172.21.15.12:0/3195980658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc8149cb0 con 0x7f6cc80d24f0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.216+0000 7f6cbdd9b640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 0x7f6cc81f4b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6cb002a220 tx=0x7f6cb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.216+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0041020 con 0x7f6cc80d24f0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.216+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb00306c0 con 0x7f6cc80d24f0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.216+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc8149f90 con 0x7f6cc80d24f0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.216+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0037040 con 0x7f6cc80d24f0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.216+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc814a550 con 0x7f6cc80d24f0 2024-09-10T09:23:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.217+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc81f7e30 con 0x7f6cc80d24f0 2024-09-10T09:23:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.217+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f6cb0044020 con 0x7f6cc80d24f0 2024-09-10T09:23:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.218+0000 7f6cbf7fe640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6ca806bef0 0x7f6ca806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.218+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6cb00ab560 con 0x7f6cc80d24f0 2024-09-10T09:23:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.218+0000 7f6cc659c640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6ca806bef0 0x7f6ca806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.219+0000 7f6cc659c640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6ca806bef0 0x7f6ca806e3b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80079a0 tx=0x7f6cb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.222+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cc81f7e30 con 0x7f6cc80d24f0 2024-09-10T09:23:30.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.427+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol3162", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f6cc80d2960 con 0x7f6ca806bef0 2024-09-10T09:23:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.445+0000 7f6cbf7fe640 1 -- 172.21.15.12:0/3195980658 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6cc80d2960 con 0x7f6ca806bef0 2024-09-10T09:23:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6ca806bef0 msgr2=0x7f6ca806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6ca806bef0 0x7f6ca806e3b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80079a0 tx=0x7f6cb8008040 comp rx=0 tx=0).stop 2024-09-10T09:23:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 msgr2=0x7f6cc81f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 0x7f6cc81f4b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6cb002a220 tx=0x7f6cb00046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 shutdown_connections 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6ca806bef0 0x7f6ca806e3b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cc815eb10 0x7f6cc81615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cc80d24f0 0x7f6cc81f4b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 --2- 172.21.15.12:0/3195980658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc8070d30 0x7f6cc813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 >> 172.21.15.12:0/3195980658 conn(0x7f6cc806f370 msgr2=0x7f6cc815abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 shutdown_connections 2024-09-10T09:23:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.447+0000 7f6ccca74640 1 -- 172.21.15.12:0/3195980658 wait complete. 2024-09-10T09:23:30.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp94400 2024-09-10T09:23:30.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.564+0000 7f33423c6640 1 Processor -- start 2024-09-10T09:23:30.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.564+0000 7f33423c6640 1 -- start start 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.564+0000 7f33423c6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c161e30 0x7f333c0d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.564+0000 7f33423c6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333c0cf9a0 con 0x7f333c06dfd0 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.564+0000 7f33423c6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333c162210 con 0x7f333c0b3d50 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.564+0000 7f33423c6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f333c0cfcf0 con 0x7f333c161e30 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f3340963640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f333c06dfd0 0x7f333c0b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46756/0 (socket says 172.21.15.12:46756) 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f3340963640 1 -- 172.21.15.12:0/2980359348 learned_addr learned my addr 172.21.15.12:0/2980359348 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333bfff640 1 --2- 172.21.15.12:0/2980359348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c161e30 0x7f333c0d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063614568 0 0) 0x7f333c0cf9a0 con 0x7f333c06dfd0 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3324003520 con 0x7f333c06dfd0 2024-09-10T09:23:30.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132814511 0 0) 0x7f333c162210 con 0x7f333c0b3d50 2024-09-10T09:23:30.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f333c0cf9a0 con 0x7f333c0b3d50 2024-09-10T09:23:30.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333bfff640 1 -- 172.21.15.12:0/2980359348 >> v1:172.21.15.100:6789/0 conn(0x7f333c0b3d50 legacy=0x7f333c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333bfff640 1 -- 172.21.15.12:0/2980359348 >> v1:172.21.15.12:6789/0 conn(0x7f333c06dfd0 legacy=0x7f333c0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3921030185 0 0) 0x7f3324003520 con 0x7f333c06dfd0 2024-09-10T09:23:30.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.565+0000 7f333bfff640 1 -- 172.21.15.12:0/2980359348 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c0d5210 con 0x7f333c161e30 2024-09-10T09:23:30.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.566+0000 7f333bfff640 1 --2- 172.21.15.12:0/2980359348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c161e30 0x7f333c0d34a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f332c0097d0 tx=0x7f332c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae39a847ddd3781 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:30.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.566+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c037070 con 0x7f333c161e30 2024-09-10T09:23:30.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.566+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c02ac30 con 0x7f333c161e30 2024-09-10T09:23:30.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.566+0000 7f333affd640 1 -- 172.21.15.12:0/2980359348 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334001a10 con 0x7f333c161e30 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 -- 172.21.15.12:0/2980359348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c161e30 msgr2=0x7f333c0d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 --2- 172.21.15.12:0/2980359348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c161e30 0x7f333c0d34a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f332c0097d0 tx=0x7f332c02a1a0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 -- 172.21.15.12:0/2980359348 shutdown_connections 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 --2- 172.21.15.12:0/2980359348 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c161e30 0x7f333c0d34a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 -- 172.21.15.12:0/2980359348 >> 172.21.15.12:0/2980359348 conn(0x7f333c0d1870 msgr2=0x7f333c0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 -- 172.21.15.12:0/2980359348 shutdown_connections 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.567+0000 7f33423c6640 1 -- 172.21.15.12:0/2980359348 wait complete. 2024-09-10T09:23:30.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.568+0000 7f33423c6640 1 Processor -- start 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.568+0000 7f33423c6640 1 -- start start 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f33423c6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c06dfd0 0x7f333c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f33423c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c0b3d50 0x7f333c0b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f33423c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 0x7f333c0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f33423c6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f333c0d39e0 con 0x7f333c161e30 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f33423c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f333c0b3950 con 0x7f333c0b3d50 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f33423c6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f333c0b41b0 con 0x7f333c06dfd0 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 0x7f333c0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 0x7f333c0b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33588/0 (socket says 172.21.15.12:33588) 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 -- 172.21.15.12:0/2342605341 learned_addr learned my addr 172.21.15.12:0/2342605341 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f333bfff640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c06dfd0 0x7f333c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f333b7fe640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c0b3d50 0x7f333c0b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 -- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c06dfd0 msgr2=0x7f333c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c06dfd0 0x7f333c152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 -- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c0b3d50 msgr2=0x7f333c0b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c0b3d50 0x7f333c0b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f3340963640 1 -- 172.21.15.12:0/2342605341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c1591f0 con 0x7f333c161e30 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f333bfff640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c06dfd0 0x7f333c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.569+0000 7f333b7fe640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c0b3d50 0x7f333c0b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.570+0000 7f3340963640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 0x7f333c0b5b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f333400c7f0 tx=0x7f333400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.570+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334018070 con 0x7f333c161e30 2024-09-10T09:23:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.570+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c1594d0 con 0x7f333c161e30 2024-09-10T09:23:30.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.570+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333400a640 con 0x7f333c161e30 2024-09-10T09:23:30.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.570+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333400aa10 con 0x7f333c161e30 2024-09-10T09:23:30.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.570+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c0b4400 con 0x7f333c161e30 2024-09-10T09:23:30.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.571+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333c0b3290 con 0x7f333c161e30 2024-09-10T09:23:30.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.571+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f333400abb0 con 0x7f333c161e30 2024-09-10T09:23:30.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.572+0000 7f3338ff9640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f332806bec0 0x7f332806e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:30.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.572+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f333408a520 con 0x7f333c161e30 2024-09-10T09:23:30.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.572+0000 7f333bfff640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f332806bec0 0x7f332806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:30.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.572+0000 7f333bfff640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f332806bec0 0x7f332806e380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f332c034000 tx=0x7f332c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:30.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.576+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3334058e60 con 0x7f333c161e30 2024-09-10T09:23:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.777+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp94400", "target": ["mon-mgr", ""]}) -- 0x7f333c0ba390 con 0x7f332806bec0 2024-09-10T09:23:30.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.783+0000 7f3338ff9640 1 -- 172.21.15.12:0/2342605341 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f333c0ba390 con 0x7f332806bec0 2024-09-10T09:23:30.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f332806bec0 msgr2=0x7f332806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f332806bec0 0x7f332806e380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f332c034000 tx=0x7f332c02e000 comp rx=0 tx=0).stop 2024-09-10T09:23:30.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 msgr2=0x7f333c0b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:30.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 0x7f333c0b5b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f333400c7f0 tx=0x7f333400ccb0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 shutdown_connections 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f332806bec0 0x7f332806e380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c161e30 0x7f333c0b5b40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f333c0b3d50 0x7f333c0b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 --2- 172.21.15.12:0/2342605341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f333c06dfd0 0x7f333c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 >> 172.21.15.12:0/2342605341 conn(0x7f333c0d1870 msgr2=0x7f333c0b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 shutdown_connections 2024-09-10T09:23:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30.784+0000 7f33423c6640 1 -- 172.21.15.12:0/2342605341 wait complete. 2024-09-10T09:23:30.796 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-10T09:23:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:23:30.852 INFO:teuthology.orchestra.run.smithi012.stdout:2 2024-09-10T09:23:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:23:30.858 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T09:23:30.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T09:23:30.898 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T09:23:30.942 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T09:23:30.942 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T09:23:30.942 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:30.942 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:30.958 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:30.958 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:31.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T09:23:31.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.159+0000 7ff6f9913640 1 Processor -- start 2024-09-10T09:23:31.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.159+0000 7ff6f9913640 1 -- start start 2024-09-10T09:23:31.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f9913640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f9913640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f40b7170 con 0x7ff6f415e940 2024-09-10T09:23:31.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f9913640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f40b7aa0 con 0x7ff6f415ed20 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f9913640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f40d3660 con 0x7ff6f40b8f90 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f2ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff6f415e940 0x7ff6f40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46760/0 (socket says 172.21.15.12:46760) 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f2ffd640 1 -- 172.21.15.12:0/2898560669 learned_addr learned my addr 172.21.15.12:0/2898560669 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.160+0000 7ff6f37fe640 1 --2- 172.21.15.12:0/2898560669 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194800801 0 0) 0x7ff6e4001490 con 0x7ff6f415e940 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e0003520 con 0x7ff6f415e940 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027071527 0 0) 0x7ff6f40b7aa0 con 0x7ff6f415ed20 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6e4001490 con 0x7ff6f415ed20 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f37fe640 1 -- 172.21.15.12:0/2898560669 >> v1:172.21.15.100:6789/0 conn(0x7ff6f415ed20 legacy=0x7ff6f40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f37fe640 1 -- 172.21.15.12:0/2898560669 >> v1:172.21.15.12:6789/0 conn(0x7ff6f415e940 legacy=0x7ff6f40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.161+0000 7ff6f37fe640 1 -- 172.21.15.12:0/2898560669 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f40d3940 con 0x7ff6f40b8f90 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f37fe640 1 --2- 172.21.15.12:0/2898560669 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f40b3930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b7c70 tx=0x7ff6ec02a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb69eded61621c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec037070 con 0x7ff6f40b8f90 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec032440 con 0x7ff6f40b8f90 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f1ffb640 1 -- 172.21.15.12:0/2898560669 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0327f0 con 0x7ff6f40b8f90 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 -- 172.21.15.12:0/2898560669 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 msgr2=0x7ff6f40b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2898560669 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f40b3930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b7c70 tx=0x7ff6ec02a200 comp rx=0 tx=0).stop 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 -- 172.21.15.12:0/2898560669 shutdown_connections 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2898560669 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f40b3930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 -- 172.21.15.12:0/2898560669 >> 172.21.15.12:0/2898560669 conn(0x7ff6f40b6240 msgr2=0x7ff6f40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 -- 172.21.15.12:0/2898560669 shutdown_connections 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.162+0000 7ff6f9913640 1 -- 172.21.15.12:0/2898560669 wait complete. 2024-09-10T09:23:31.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.163+0000 7ff6f9913640 1 Processor -- start 2024-09-10T09:23:31.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 -- start start 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 0x7ff6f4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f415ed20 0x7ff6f41614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f40d3310 con 0x7ff6f415e940 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f40d3f00 con 0x7ff6f415ed20 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f9913640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f40d1ef0 con 0x7ff6f40b8f90 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 0x7ff6f4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 0x7ff6f4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33590/0 (socket says 172.21.15.12:33590) 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.164+0000 7ff6f27fc640 1 -- 172.21.15.12:0/2932020377 learned_addr learned my addr 172.21.15.12:0/2932020377 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f2ffd640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f4158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f37fe640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f415ed20 0x7ff6f41614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f27fc640 1 -- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 msgr2=0x7ff6f4158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f27fc640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f4158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f27fc640 1 -- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f415ed20 msgr2=0x7ff6f41614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f27fc640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f415ed20 0x7ff6f41614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f27fc640 1 -- 172.21.15.12:0/2932020377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f41f4810 con 0x7ff6f415e940 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f27fc640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 0x7ff6f4159fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc001eb0 tx=0x7ff6dc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc017070 con 0x7ff6f415e940 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f415aa90 con 0x7ff6f415e940 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0052d0 con 0x7ff6f415e940 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc003810 con 0x7ff6f415e940 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.165+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f415b050 con 0x7ff6f415e940 2024-09-10T09:23:31.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.166+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f40cef90 con 0x7ff6f415e940 2024-09-10T09:23:31.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.167+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7ff6dc01a070 con 0x7ff6f415e940 2024-09-10T09:23:31.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.167+0000 7ff6ebfff640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff6d406bec0 0x7ff6d406e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.167+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff6dc08a200 con 0x7ff6f415e940 2024-09-10T09:23:31.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.167+0000 7ff6f2ffd640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff6d406bec0 0x7ff6d406e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.168+0000 7ff6f2ffd640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff6d406bec0 0x7ff6d406e380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4002230 tx=0x7ff6e4001c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:31.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.171+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6dc0584f0 con 0x7ff6f415e940 2024-09-10T09:23:31.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.320+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff6dc054b60 con 0x7ff6f415e940 2024-09-10T09:23:31.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.366+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff6f40ba6b0 con 0x7ff6f415e940 2024-09-10T09:23:31.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.366+0000 7ff6ebfff640 1 -- 172.21.15.12:0/2932020377 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7ff6dc058bf0 con 0x7ff6f415e940 2024-09-10T09:23:31.367 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-10T09:23:31.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff6d406bec0 msgr2=0x7ff6d406e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff6d406bec0 0x7ff6d406e380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4002230 tx=0x7ff6e4001c60 comp rx=0 tx=0).stop 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 msgr2=0x7ff6f4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 0x7ff6f4159fa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc001eb0 tx=0x7ff6dc00c820 comp rx=0 tx=0).stop 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 shutdown_connections 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff6d406bec0 0x7ff6d406e380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6f415ed20 0x7ff6f41614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f415e940 0x7ff6f4159fa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 --2- 172.21.15.12:0/2932020377 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6f40b8f90 0x7ff6f4158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.368+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 >> 172.21.15.12:0/2932020377 conn(0x7ff6f40b6240 msgr2=0x7ff6f40d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.369+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 shutdown_connections 2024-09-10T09:23:31.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.369+0000 7ff6f9913640 1 -- 172.21.15.12:0/2932020377 wait complete. 2024-09-10T09:23:31.380 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T09:23:31.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:31.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T09:23:31.410 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:23:31.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:31.410 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T09:23:31.466 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T09:23:31.467 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:31.467 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:31.486 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:31.486 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:31.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T09:23:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 Processor -- start 2024-09-10T09:23:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 -- start start 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f207415e940 0x7f20740d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f207415ed20 0x7f20740d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20740b7170 con 0x7f20740cef90 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f20740d1ae0 con 0x7f207415ed20 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.648+0000 7f207a22e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f20740b7aa0 con 0x7f207415e940 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f207415ed20 0x7f20740d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f207415ed20 0x7f20740d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33600/0 (socket says 172.21.15.12:33600) 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 -- 172.21.15.12:0/3469702758 learned_addr learned my addr 172.21.15.12:0/3469702758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f20737fe640 1 --2- 172.21.15.12:0/3469702758 >> v2:172.21.15.100:3300/0 conn(0x7f207415e940 0x7f20740d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 -- 172.21.15.12:0/3469702758 >> v2:172.21.15.100:3300/0 conn(0x7f207415e940 msgr2=0x7f20740d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 --2- 172.21.15.12:0/3469702758 >> v2:172.21.15.100:3300/0 conn(0x7f207415e940 0x7f20740d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 -- 172.21.15.12:0/3469702758 >> v1:172.21.15.100:6789/0 conn(0x7f20740cef90 legacy=0x7f20740b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.649+0000 7f2072ffd640 1 -- 172.21.15.12:0/3469702758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740d3660 con 0x7f207415ed20 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.650+0000 7f2072ffd640 1 --2- 172.21.15.12:0/3469702758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415ed20 0x7f20740d15a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20740509d0 tx=0x7f206802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3418c466bbaa3383 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.650+0000 7f20727fc640 1 -- 172.21.15.12:0/3469702758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068037070 con 0x7f207415ed20 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.650+0000 7f20727fc640 1 -- 172.21.15.12:0/3469702758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206802ae50 con 0x7f207415ed20 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.650+0000 7f20727fc640 1 -- 172.21.15.12:0/3469702758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068032860 con 0x7f207415ed20 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.650+0000 7f207a22e640 1 -- 172.21.15.12:0/3469702758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415ed20 msgr2=0x7f20740d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.650+0000 7f207a22e640 1 --2- 172.21.15.12:0/3469702758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415ed20 0x7f20740d15a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20740509d0 tx=0x7f206802a300 comp rx=0 tx=0).stop 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.651+0000 7f207a22e640 1 -- 172.21.15.12:0/3469702758 shutdown_connections 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.651+0000 7f207a22e640 1 --2- 172.21.15.12:0/3469702758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415ed20 0x7f20740d15a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.651+0000 7f207a22e640 1 --2- 172.21.15.12:0/3469702758 >> v2:172.21.15.100:3300/0 conn(0x7f207415e940 0x7f20740d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.651+0000 7f207a22e640 1 -- 172.21.15.12:0/3469702758 >> 172.21.15.12:0/3469702758 conn(0x7f20740b6240 msgr2=0x7f20740b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.651+0000 7f207a22e640 1 -- 172.21.15.12:0/3469702758 shutdown_connections 2024-09-10T09:23:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.651+0000 7f207a22e640 1 -- 172.21.15.12:0/3469702758 wait complete. 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.652+0000 7f207a22e640 1 Processor -- start 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.652+0000 7f207a22e640 1 -- start start 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20740cef90 0x7f207414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 0x7f207415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f207415ed20 0x7f20741f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20740d3f00 con 0x7f207415e940 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f20740d3c20 con 0x7f207415ed20 2024-09-10T09:23:31.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f20740d3310 con 0x7f20740cef90 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 0x7f207415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 0x7f207415b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33610/0 (socket says 172.21.15.12:33610) 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 -- 172.21.15.12:0/2770039702 learned_addr learned my addr 172.21.15.12:0/2770039702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2073fff640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f207415ed20 0x7f20741f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f20737fe640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20740cef90 0x7f207414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 -- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20740cef90 msgr2=0x7f207414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20740cef90 0x7f207414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 -- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f207415ed20 msgr2=0x7f20741f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f207415ed20 0x7f20741f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 -- 172.21.15.12:0/2770039702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740cce10 con 0x7f207415e940 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2073fff640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f207415ed20 0x7f20741f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f2072ffd640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 0x7f207415b3a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f206802a340 tx=0x7f20680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068041070 con 0x7f207415e940 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206803c660 con 0x7f207415e940 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20740cd0f0 con 0x7f207415e940 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.653+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068037040 con 0x7f207415e940 2024-09-10T09:23:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.654+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20740cdaa0 con 0x7f207415e940 2024-09-10T09:23:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.655+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20740cd2c0 con 0x7f207415e940 2024-09-10T09:23:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.655+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2068044070 con 0x7f207415e940 2024-09-10T09:23:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.656+0000 7f205bfff640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f206006bfe0 0x7f206006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.656+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f20680ab8a0 con 0x7f207415e940 2024-09-10T09:23:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.656+0000 7f20737fe640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f206006bfe0 0x7f206006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.656+0000 7f20737fe640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f206006bfe0 0x7f206006e4a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2064009ad0 tx=0x7f2064008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:31.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.660+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f206807a060 con 0x7f207415e940 2024-09-10T09:23:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.849+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f207406d470 con 0x7f207415e940 2024-09-10T09:23:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.849+0000 7f205bfff640 1 -- 172.21.15.12:0/2770039702 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f207406d470 con 0x7f207415e940 2024-09-10T09:23:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-10T09:23:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f206006bfe0 msgr2=0x7f206006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f206006bfe0 0x7f206006e4a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2064009ad0 tx=0x7f2064008040 comp rx=0 tx=0).stop 2024-09-10T09:23:31.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 msgr2=0x7f207415b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 0x7f207415b3a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f206802a340 tx=0x7f20680046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 shutdown_connections 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f206006bfe0 0x7f206006e4a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f207415ed20 0x7f20741f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207415e940 0x7f207415b3a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 --2- 172.21.15.12:0/2770039702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f20740cef90 0x7f207414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.851+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 >> 172.21.15.12:0/2770039702 conn(0x7f20740b6240 msgr2=0x7f20740b9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.852+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 shutdown_connections 2024-09-10T09:23:31.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:31.852+0000 7f207a22e640 1 -- 172.21.15.12:0/2770039702 wait complete. 2024-09-10T09:23:31.863 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T09:23:31.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:31.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T09:23:31.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:23:31.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:31.897 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T09:23:31.955 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T09:23:31.955 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:31.955 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:31.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=100 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T09:23:31.972 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T09:23:31.972 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:31.972 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:32.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2441 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T09:23:32.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.115+0000 7f45861b7640 1 Processor -- start 2024-09-10T09:23:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.115+0000 7f45861b7640 1 -- start start 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.115+0000 7f45861b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45800cf070 0x7f45800cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.115+0000 7f45861b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4580073120 0x7f4580073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f45861b7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45800ce740 con 0x7f458015c180 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f45861b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4580072640 con 0x7f4580073120 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f45861b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4580072920 con 0x7f45800cf070 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f458015c180 0x7f45800cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46762/0 (socket says 172.21.15.12:46762) 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457f7fe640 1 -- 172.21.15.12:0/4201382018 learned_addr learned my addr 172.21.15.12:0/4201382018 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457ffff640 1 --2- 172.21.15.12:0/4201382018 >> v2:172.21.15.100:3300/0 conn(0x7f4580073120 0x7f4580073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457effd640 1 --2- 172.21.15.12:0/4201382018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45800cf070 0x7f45800cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457e7fc640 1 -- 172.21.15.12:0/4201382018 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618711066 0 0) 0x7f45800ce740 con 0x7f458015c180 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457e7fc640 1 -- 172.21.15.12:0/4201382018 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f456c003520 con 0x7f458015c180 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457effd640 1 -- 172.21.15.12:0/4201382018 >> v2:172.21.15.100:3300/0 conn(0x7f4580073120 msgr2=0x7f4580073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457effd640 1 --2- 172.21.15.12:0/4201382018 >> v2:172.21.15.100:3300/0 conn(0x7f4580073120 0x7f4580073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457effd640 1 -- 172.21.15.12:0/4201382018 >> v1:172.21.15.12:6789/0 conn(0x7f458015c180 legacy=0x7f45800cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457effd640 1 -- 172.21.15.12:0/4201382018 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4580072c00 con 0x7f45800cf070 2024-09-10T09:23:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.116+0000 7f457ffff640 1 --2- 172.21.15.12:0/4201382018 >> v2:172.21.15.100:3300/0 conn(0x7f4580073120 0x7f4580073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.117+0000 7f457effd640 1 --2- 172.21.15.12:0/4201382018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45800cf070 0x7f45800cf4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45680097a0 tx=0x7f456802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7917218dd71443f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.117+0000 7f457e7fc640 1 -- 172.21.15.12:0/4201382018 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568037070 con 0x7f45800cf070 2024-09-10T09:23:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.117+0000 7f457e7fc640 1 -- 172.21.15.12:0/4201382018 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f456802ae50 con 0x7f45800cf070 2024-09-10T09:23:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.117+0000 7f457e7fc640 1 -- 172.21.15.12:0/4201382018 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568032640 con 0x7f45800cf070 2024-09-10T09:23:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 -- 172.21.15.12:0/4201382018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45800cf070 msgr2=0x7f45800cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 --2- 172.21.15.12:0/4201382018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45800cf070 0x7f45800cf4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45680097a0 tx=0x7f456802a100 comp rx=0 tx=0).stop 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 -- 172.21.15.12:0/4201382018 shutdown_connections 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 --2- 172.21.15.12:0/4201382018 >> v2:172.21.15.100:3300/0 conn(0x7f4580073120 0x7f4580073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 --2- 172.21.15.12:0/4201382018 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45800cf070 0x7f45800cf4b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 -- 172.21.15.12:0/4201382018 >> 172.21.15.12:0/4201382018 conn(0x7f4580062cc0 msgr2=0x7f458006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 -- 172.21.15.12:0/4201382018 shutdown_connections 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.118+0000 7f45861b7640 1 -- 172.21.15.12:0/4201382018 wait complete. 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.120+0000 7f45861b7640 1 Processor -- start 2024-09-10T09:23:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.120+0000 7f45861b7640 1 -- start start 2024-09-10T09:23:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f45861b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 0x7f45800b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f45861b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45800cf070 0x7f458015f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f45861b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458015c180 0x7f45800b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f45861b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45800722f0 con 0x7f4580073120 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f45861b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45800ced00 con 0x7f45800cf070 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f45861b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f458015c560 con 0x7f458015c180 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 0x7f45800b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 0x7f45800b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33626/0 (socket says 172.21.15.12:33626) 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 -- 172.21.15.12:0/3824425115 learned_addr learned my addr 172.21.15.12:0/3824425115 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457effd640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45800cf070 0x7f458015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457ffff640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458015c180 0x7f45800b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 -- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458015c180 msgr2=0x7f45800b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458015c180 0x7f45800b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 -- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45800cf070 msgr2=0x7f458015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45800cf070 0x7f458015f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 -- 172.21.15.12:0/3824425115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45801f2430 con 0x7f4580073120 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.121+0000 7f457f7fe640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 0x7f45800b1ed0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f457000c4d0 tx=0x7f457000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.122+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570017070 con 0x7f4580073120 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.122+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4570005ce0 con 0x7f4580073120 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.122+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45801f2710 con 0x7f4580073120 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.122+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570007310 con 0x7f4580073120 2024-09-10T09:23:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.122+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45801f2cd0 con 0x7f4580073120 2024-09-10T09:23:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.123+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45800cf4b0 con 0x7f4580073120 2024-09-10T09:23:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.123+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f457001a070 con 0x7f4580073120 2024-09-10T09:23:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.124+0000 7f4577fff640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f456006bfe0 0x7f456006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.124+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f457008a410 con 0x7f4580073120 2024-09-10T09:23:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.124+0000 7f457effd640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f456006bfe0 0x7f456006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.125+0000 7f457effd640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f456006bfe0 0x7f456006e4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4568034000 tx=0x7f456802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.129+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4570058580 con 0x7f4580073120 2024-09-10T09:23:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.339+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45800d0100 con 0x7f4580073120 2024-09-10T09:23:32.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.340+0000 7f4577fff640 1 -- 172.21.15.12:0/3824425115 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5223 (secure 0 0 0) 0x7f457005c880 con 0x7f4580073120 2024-09-10T09:23:32.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:32.341 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"btime":"2024-09-10T09:23:27:299655+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:23:14.438605+0000","modified":"2024-09-10T09:23:16.449169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4714":{"gid":4714,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/694322310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":694322310},{"type":"v1","addr":"172.21.15.100:6836","nonce":694322310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4714,"qdb_cluster":[4714]},"id":2}]} 2024-09-10T09:23:32.341 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 15 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f456006bfe0 msgr2=0x7f456006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f456006bfe0 0x7f456006e4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4568034000 tx=0x7f456802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 msgr2=0x7f45800b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 0x7f45800b1ed0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f457000c4d0 tx=0x7f457000c8d0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 shutdown_connections 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f456006bfe0 0x7f456006e4a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f458015c180 0x7f45800b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45800cf070 0x7f458015f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 --2- 172.21.15.12:0/3824425115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4580073120 0x7f45800b1ed0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 >> 172.21.15.12:0/3824425115 conn(0x7f4580062cc0 msgr2=0x7f458006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 shutdown_connections 2024-09-10T09:23:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.342+0000 7f45861b7640 1 -- 172.21.15.12:0/3824425115 wait complete. 2024-09-10T09:23:32.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:32.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.456+0000 7fbcd9598640 1 Processor -- start 2024-09-10T09:23:32.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.456+0000 7fbcd9598640 1 -- start start 2024-09-10T09:23:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd9598640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbcd40b8f90 0x7fbcd40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd9598640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd40b7170 con 0x7fbcd415e940 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd9598640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd40b7aa0 con 0x7fbcd415ed20 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd9598640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd40d3660 con 0x7fbcd40b8f90 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd2ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbcd415e940 0x7fbcd40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53524/0 (socket says 172.21.15.12:53524) 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd2ffd640 1 -- 172.21.15.12:0/756662536 learned_addr learned my addr 172.21.15.12:0/756662536 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd37fe640 1 --2- 172.21.15.12:0/756662536 >> v2:172.21.15.100:3300/0 conn(0x7fbcd40b8f90 0x7fbcd40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626697527 0 0) 0x7fbcc4001110 con 0x7fbcd415e940 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.457+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcbc003520 con 0x7fbcd415e940 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2302336550 0 0) 0x7fbcbc003520 con 0x7fbcd415e940 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 >> v2:172.21.15.100:3300/0 conn(0x7fbcd40b8f90 msgr2=0x7fbcd40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 --2- 172.21.15.12:0/756662536 >> v2:172.21.15.100:3300/0 conn(0x7fbcd40b8f90 0x7fbcd40b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 >> v1:172.21.15.100:6789/0 conn(0x7fbcd415ed20 legacy=0x7fbcd40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40d3940 con 0x7fbcd415e940 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fbcc4001840 con 0x7fbcd415e940 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 >> v1:172.21.15.12:6789/0 conn(0x7fbcd415e940 legacy=0x7fbcd40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc004800 0x7fbcbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc0051c0 0x7fbcbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d3660 con 0x7fbcbc0039b0 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc00c070 con 0x7fbcbc0051c0 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbcbc00c270 con 0x7fbcbc004800 2024-09-10T09:23:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd27fc640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc004800 0x7fbcbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd37fe640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc0051c0 0x7fbcbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd2ffd640 1 -- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc004800 msgr2=0x7fbcbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc004800 0x7fbcbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd2ffd640 1 -- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc0051c0 msgr2=0x7fbcbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc0051c0 0x7fbcbc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd2ffd640 1 -- 172.21.15.12:0/756662536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc003520 con 0x7fbcbc0039b0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd37fe640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc0051c0 0x7fbcbc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.458+0000 7fbcd37fe640 1 -- 172.21.15.12:0/756662536 reap_dead start 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.459+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c4c0 tx=0x7fbcbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd607ac19cc9435 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.459+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400c0e0 con 0x7fbcbc0039b0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.459+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4034070 con 0x7fbcbc0039b0 2024-09-10T09:23:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.459+0000 7fbcd1ffb640 1 -- 172.21.15.12:0/756662536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4005d70 con 0x7fbcbc0039b0 2024-09-10T09:23:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 -- 172.21.15.12:0/756662536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc0039b0 msgr2=0x7fbcbc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400c4c0 tx=0x7fbcbc005830 comp rx=0 tx=0).stop 2024-09-10T09:23:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 -- 172.21.15.12:0/756662536 shutdown_connections 2024-09-10T09:23:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 --2- 172.21.15.12:0/756662536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003dd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 -- 172.21.15.12:0/756662536 >> 172.21.15.12:0/756662536 conn(0x7fbcd40b6240 msgr2=0x7fbcd40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 -- 172.21.15.12:0/756662536 shutdown_connections 2024-09-10T09:23:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.460+0000 7fbcd9598640 1 -- 172.21.15.12:0/756662536 wait complete. 2024-09-10T09:23:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.461+0000 7fbcd9598640 1 Processor -- start 2024-09-10T09:23:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.461+0000 7fbcd9598640 1 -- start start 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd9598640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc0039b0 0x7fbcd40b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd9598640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 0x7fbcd40cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd9598640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd40c8c30 0x7fbcd40c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd9598640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d1ef0 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd9598640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d3f00 con 0x7fbcd40c8c30 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd9598640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd40d2070 con 0x7fbcbc0039b0 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 0x7fbcd40cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 0x7fbcd40cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44654/0 (socket says 172.21.15.12:44654) 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 -- 172.21.15.12:0/1916568105 learned_addr learned my addr 172.21.15.12:0/1916568105 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc0039b0 0x7fbcd40b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd37fe640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd40c8c30 0x7fbcd40c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 -- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc0039b0 msgr2=0x7fbcd40b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc0039b0 0x7fbcd40b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 -- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd40c8c30 msgr2=0x7fbcd40c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd40c8c30 0x7fbcd40c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 -- 172.21.15.12:0/1916568105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40b5f40 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd37fe640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd40c8c30 0x7fbcd40c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcd27fc640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 0x7fbcd40cde50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800f7f0 tx=0x7fbcc800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc80050d0 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc8018070 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.462+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8005490 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.463+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd41f4950 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.463+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41f4f10 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.463+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd40cf020 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.464+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fbcc800d6d0 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.465+0000 7fbcbb7fe640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbcc006bfe0 0x7fbcc006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.465+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbcc808aed0 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.465+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbcc006bfe0 0x7fbcc006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.465+0000 7fbcd2ffd640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbcc006bfe0 0x7fbcc006e4a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4033000 tx=0x7fbcc402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.469+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcc8059690 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.681+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcd40ba6b0 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.682+0000 7fbcbb7fe640 1 -- 172.21.15.12:0/1916568105 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5223 (secure 0 0 0) 0x7fbcc8058f90 con 0x7fbcd40cd9d0 2024-09-10T09:23:32.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:32.683 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"btime":"2024-09-10T09:23:27:299655+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:23:14.438605+0000","modified":"2024-09-10T09:23:16.449169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4714":{"gid":4714,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/694322310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":694322310},{"type":"v1","addr":"172.21.15.100:6836","nonce":694322310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4714,"qdb_cluster":[4714]},"id":2}]} 2024-09-10T09:23:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 15 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbcc006bfe0 msgr2=0x7fbcc006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbcc006bfe0 0x7fbcc006e4a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4033000 tx=0x7fbcc402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 msgr2=0x7fbcd40cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 0x7fbcd40cde50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800f7f0 tx=0x7fbcc800fcb0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 shutdown_connections 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fbcc006bfe0 0x7fbcc006e4a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcd40c8c30 0x7fbcd40c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd40cd9d0 0x7fbcd40cde50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 --2- 172.21.15.12:0/1916568105 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbcbc0039b0 0x7fbcd40b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 >> 172.21.15.12:0/1916568105 conn(0x7fbcd40b6240 msgr2=0x7fbcd40d2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 shutdown_connections 2024-09-10T09:23:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.684+0000 7fbcd9598640 1 -- 172.21.15.12:0/1916568105 wait complete. 2024-09-10T09:23:32.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:32.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.799+0000 7f353476d640 1 Processor -- start 2024-09-10T09:23:32.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.799+0000 7f353476d640 1 -- start start 2024-09-10T09:23:32.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f353476d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 0x7f352c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f353476d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f352c0b7170 con 0x7f352c15e940 2024-09-10T09:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f353476d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f352c0b7aa0 con 0x7f352c0cef90 2024-09-10T09:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f353476d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f352c0d3660 con 0x7f352c15ed20 2024-09-10T09:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f3532509640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f352c15e940 0x7f352c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53532/0 (socket says 172.21.15.12:53532) 2024-09-10T09:23:32.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f3532509640 1 -- 172.21.15.12:0/3259389397 learned_addr learned my addr 172.21.15.12:0/3259389397 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:32.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f3531d08640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 0x7f352c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437593849 0 0) 0x7f3520001110 con 0x7f352c15e940 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.800+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3518003520 con 0x7f352c15e940 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2637354485 0 0) 0x7f3518003520 con 0x7f352c15e940 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 msgr2=0x7f352c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 0x7f352c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 >> v1:172.21.15.100:6789/0 conn(0x7f352c0cef90 legacy=0x7f352c0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c0d3940 con 0x7f352c15e940 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f3520001840 con 0x7f352c15e940 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 >> v1:172.21.15.12:6789/0 conn(0x7f352c15e940 legacy=0x7f352c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 0x7f35180039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3518003f60 0x7f3518004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f35180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f352c0d3660 con 0x7f3518004d40 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f351800bb30 con 0x7f3518003f60 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f351800bd30 con 0x7f352c15ed20 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532d0a640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f35180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532509640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 0x7f35180039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3531d08640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3518003f60 0x7f3518004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532d0a640 1 -- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 msgr2=0x7f35180039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532d0a640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c15ed20 0x7f35180039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532d0a640 1 -- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3518003f60 msgr2=0x7f3518004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532d0a640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3518003f60 0x7f3518004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.801+0000 7f3532d0a640 1 -- 172.21.15.12:0/3259389397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3518003520 con 0x7f3518004d40 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f3532d0a640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f35180051c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3524001e50 tx=0x7f3518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8170a77e107284c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524001a70 con 0x7f3518004d40 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524003970 con 0x7f3518004d40 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f3531507640 1 -- 172.21.15.12:0/3259389397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524003d60 con 0x7f3518004d40 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f353476d640 1 -- 172.21.15.12:0/3259389397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 msgr2=0x7f35180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f353476d640 1 --2- 172.21.15.12:0/3259389397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f35180051c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3524001e50 tx=0x7f3518005830 comp rx=0 tx=0).stop 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.802+0000 7f3532d0a640 1 -- 172.21.15.12:0/3259389397 reap_dead start 2024-09-10T09:23:32.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.803+0000 7f353476d640 1 -- 172.21.15.12:0/3259389397 shutdown_connections 2024-09-10T09:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.803+0000 7f353476d640 1 -- 172.21.15.12:0/3259389397 >> 172.21.15.12:0/3259389397 conn(0x7f352c0b6240 msgr2=0x7f352c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.803+0000 7f353476d640 1 -- 172.21.15.12:0/3259389397 shutdown_connections 2024-09-10T09:23:32.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.803+0000 7f353476d640 1 -- 172.21.15.12:0/3259389397 wait complete. 2024-09-10T09:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.804+0000 7f353476d640 1 Processor -- start 2024-09-10T09:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.804+0000 7f353476d640 1 -- start start 2024-09-10T09:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f352c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c1f57b0 0x7f352c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c159680 0x7f352c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f352c0d3310 con 0x7f3518004d40 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f352c0d3f00 con 0x7f352c1f57b0 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f352c0d1ef0 con 0x7f352c159680 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f352c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f352c1548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44662/0 (socket says 172.21.15.12:44662) 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 -- 172.21.15.12:0/3929393573 learned_addr learned my addr 172.21.15.12:0/3929393573 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3531d08640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c1f57b0 0x7f352c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532d0a640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c159680 0x7f352c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 -- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c159680 msgr2=0x7f352c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c159680 0x7f352c15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 -- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c1f57b0 msgr2=0x7f352c159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c1f57b0 0x7f352c159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 -- 172.21.15.12:0/3929393573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c154de0 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f3532509640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f352c1548a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f35200013b0 tx=0x7f35200077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352000f9c0 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520018070 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352c157df0 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352000fda0 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.805+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352c1583b0 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.806+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f352c0d1060 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.807+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f352001d460 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.807+0000 7f351effd640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f351006bfe0 0x7f351006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.807+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f352008b250 con 0x7f3518004d40 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.808+0000 7f3531d08640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f351006bfe0 0x7f351006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.808+0000 7f3531d08640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f351006bfe0 0x7f351006e4a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f352c15bbe0 tx=0x7f3528008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:32.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.812+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f352c0b7170 con 0x7f3518004d40 2024-09-10T09:23:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.988+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f352c0ba6b0 con 0x7f3518004d40 2024-09-10T09:23:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.990+0000 7f351effd640 1 -- 172.21.15.12:0/3929393573 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16741 (secure 0 0 0) 0x7f3520059a10 con 0x7f3518004d40 2024-09-10T09:23:32.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:32.991 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:16.100995+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:23:12.362255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T09:23:13.425491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f351006bfe0 msgr2=0x7f351006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f351006bfe0 0x7f351006e4a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f352c15bbe0 tx=0x7f3528008040 comp rx=0 tx=0).stop 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 msgr2=0x7f352c1548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f352c1548a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f35200013b0 tx=0x7f35200077a0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 shutdown_connections 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f351006bfe0 0x7f351006e4a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f352c159680 0x7f352c15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c1f57b0 0x7f352c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 --2- 172.21.15.12:0/3929393573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3518004d40 0x7f352c1548a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 >> 172.21.15.12:0/3929393573 conn(0x7f352c0b6240 msgr2=0x7f352c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 shutdown_connections 2024-09-10T09:23:32.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:32.992+0000 7f353476d640 1 -- 172.21.15.12:0/3929393573 wait complete. 2024-09-10T09:23:33.004 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T09:23:33.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:33.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.105+0000 7f959e8b7640 1 Processor -- start 2024-09-10T09:23:33.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.106+0000 7f959e8b7640 1 -- start start 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.106+0000 7f959e8b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95980b5600 0x7f9598073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.106+0000 7f959e8b7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959806e8d0 con 0x7f9598073ff0 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.106+0000 7f959e8b7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959806ebb0 con 0x7f959815e7b0 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.106+0000 7f959e8b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f959806e680 con 0x7f95980b5600 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f959ce54640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9598073ff0 0x7f959806ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53544/0 (socket says 172.21.15.12:53544) 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f959ce54640 1 -- 172.21.15.12:0/521288658 learned_addr learned my addr 172.21.15.12:0/521288658 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f95977fe640 1 --2- 172.21.15.12:0/521288658 >> v2:172.21.15.100:3300/0 conn(0x7f95980b5600 0x7f9598073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669908428 0 0) 0x7f959806e8d0 con 0x7f9598073ff0 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9580003520 con 0x7f9598073ff0 2024-09-10T09:23:33.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2820487995 0 0) 0x7f9580003520 con 0x7f9598073ff0 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 >> v2:172.21.15.100:3300/0 conn(0x7f95980b5600 msgr2=0x7f9598073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 --2- 172.21.15.12:0/521288658 >> v2:172.21.15.100:3300/0 conn(0x7f95980b5600 0x7f9598073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 >> v1:172.21.15.100:6789/0 conn(0x7f959815e7b0 legacy=0x7f9598071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95980732b0 con 0x7f9598073ff0 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f95900019f0 con 0x7f9598073ff0 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 >> v1:172.21.15.12:6789/0 conn(0x7f9598073ff0 legacy=0x7f959806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800039b0 0x7f9580003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9580004800 0x7f9580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9580005210 0x7f958000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f959806e680 con 0x7f9580004800 2024-09-10T09:23:33.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f958000c140 con 0x7f95800039b0 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f958000c340 con 0x7f9580005210 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f95977fe640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9580004800 0x7f9580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.107+0000 7f9597fff640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800039b0 0x7f9580003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f959ce54640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9580005210 0x7f958000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f95977fe640 1 -- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9580005210 msgr2=0x7f958000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f95977fe640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9580005210 0x7f958000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f95977fe640 1 -- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800039b0 msgr2=0x7f9580003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f95977fe640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800039b0 0x7f9580003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f95977fe640 1 -- 172.21.15.12:0/521288658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580003520 con 0x7f9580004800 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f959ce54640 1 -- 172.21.15.12:0/521288658 reap_dead start 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.108+0000 7f95977fe640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9580004800 0x7f9580004c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f958c009a90 tx=0x7f9580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411250fc2ebda630 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c036070 con 0x7f9580004800 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958c031400 con 0x7f9580004800 2024-09-10T09:23:33.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f9596ffd640 1 -- 172.21.15.12:0/521288658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c009690 con 0x7f9580004800 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 -- 172.21.15.12:0/521288658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9580004800 msgr2=0x7f9580004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9580004800 0x7f9580004c80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f958c009a90 tx=0x7f9580005830 comp rx=0 tx=0).stop 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 -- 172.21.15.12:0/521288658 shutdown_connections 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 --2- 172.21.15.12:0/521288658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9580004800 0x7f9580004c80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 -- 172.21.15.12:0/521288658 >> 172.21.15.12:0/521288658 conn(0x7f95980b4300 msgr2=0x7f95980b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 -- 172.21.15.12:0/521288658 shutdown_connections 2024-09-10T09:23:33.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.109+0000 7f959e8b7640 1 -- 172.21.15.12:0/521288658 wait complete. 2024-09-10T09:23:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.110+0000 7f959e8b7640 1 Processor -- start 2024-09-10T09:23:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 -- start start 2024-09-10T09:23:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9580004800 0x7f95981412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9598155380 0x7f9598155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 0x7f95981ea930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9598073c30 con 0x7f95981ea4b0 2024-09-10T09:23:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9598073ab0 con 0x7f9580004800 2024-09-10T09:23:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959e8b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9598073db0 con 0x7f9598155380 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959ce54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 0x7f95981ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959ce54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 0x7f95981ea930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44674/0 (socket says 172.21.15.12:44674) 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f959ce54640 1 -- 172.21.15.12:0/1779519338 learned_addr learned my addr 172.21.15.12:0/1779519338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.111+0000 7f9597fff640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9580004800 0x7f95981412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f95977fe640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9598155380 0x7f9598155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959ce54640 1 -- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9598155380 msgr2=0x7f9598155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959ce54640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9598155380 0x7f9598155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959ce54640 1 -- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9580004800 msgr2=0x7f95981412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959ce54640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9580004800 0x7f95981412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959ce54640 1 -- 172.21.15.12:0/1779519338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95981e9410 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959ce54640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 0x7f95981ea930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f95980b6510 tx=0x7f9590007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959000ab80 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9590018070 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95981e96f0 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95900133f0 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.112+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95981e9cb0 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.113+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9598071340 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.114+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f9590013590 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.114+0000 7f9594ff9640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f958406c010 0x7f958406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.114+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f959008b4c0 con 0x7f95981ea4b0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.114+0000 7f9597fff640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f958406c010 0x7f958406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.115+0000 7f9597fff640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f958406c010 0x7f958406e4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9588000c00 tx=0x7f9588009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.119+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9590059630 con 0x7f95981ea4b0 2024-09-10T09:23:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.333+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95980b4990 con 0x7f95981ea4b0 2024-09-10T09:23:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.333+0000 7f9594ff9640 1 -- 172.21.15.12:0/1779519338 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5223 (secure 0 0 0) 0x7f959005d930 con 0x7f95981ea4b0 2024-09-10T09:23:33.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:33.335 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"btime":"2024-09-10T09:23:27:299655+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:23:14.438605+0000","modified":"2024-09-10T09:23:16.449169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4714":{"gid":4714,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/694322310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":694322310},{"type":"v1","addr":"172.21.15.100:6836","nonce":694322310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4714,"qdb_cluster":[4714]},"id":2}]} 2024-09-10T09:23:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 15 2024-09-10T09:23:33.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f958406c010 msgr2=0x7f958406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f958406c010 0x7f958406e4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9588000c00 tx=0x7f9588009040 comp rx=0 tx=0).stop 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 msgr2=0x7f95981ea930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 0x7f95981ea930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f95980b6510 tx=0x7f9590007bd0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 shutdown_connections 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f958406c010 0x7f958406e4d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95981ea4b0 0x7f95981ea930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9598155380 0x7f9598155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 --2- 172.21.15.12:0/1779519338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9580004800 0x7f95981412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 >> 172.21.15.12:0/1779519338 conn(0x7f95980b4300 msgr2=0x7f9598161820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:33.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 shutdown_connections 2024-09-10T09:23:33.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.336+0000 7f959e8b7640 1 -- 172.21.15.12:0/1779519338 wait complete. 2024-09-10T09:23:33.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:23:33.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.450+0000 7fed6856d640 1 Processor -- start 2024-09-10T09:23:33.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.450+0000 7fed6856d640 1 -- start start 2024-09-10T09:23:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed6856d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed60162c40 0x7fed600b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed6856d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 0x7fed6006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed6856d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed6015f520 con 0x7fed60162860 2024-09-10T09:23:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed6856d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fed601630b0 con 0x7fed60162c40 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed6856d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fed6015fae0 con 0x7fed600b3840 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed66309640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fed60162860 0x7fed6015ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53546/0 (socket says 172.21.15.12:53546) 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed66309640 1 -- 172.21.15.12:0/227003517 learned_addr learned my addr 172.21.15.12:0/227003517 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016073066 0 0) 0x7fed6015f520 con 0x7fed60162860 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed4c003520 con 0x7fed60162860 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed66b0a640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 0x7fed6006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65b08640 1 --2- 172.21.15.12:0/227003517 >> v2:172.21.15.100:3300/0 conn(0x7fed60162c40 0x7fed600b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2166035361 0 0) 0x7fed4c003520 con 0x7fed60162860 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 msgr2=0x7fed6006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 0x7fed6006bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 >> v2:172.21.15.100:3300/0 conn(0x7fed60162c40 msgr2=0x7fed600b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 --2- 172.21.15.12:0/227003517 >> v2:172.21.15.100:3300/0 conn(0x7fed60162c40 0x7fed600b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.451+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6015f800 con 0x7fed60162860 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fed5c001670 con 0x7fed60162860 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65b08640 1 --2- 172.21.15.12:0/227003517 >> v2:172.21.15.100:3300/0 conn(0x7fed60162c40 0x7fed600b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 >> v1:172.21.15.12:6789/0 conn(0x7fed60162860 legacy=0x7fed6015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 0x7fed4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c003fe0 0x7fed4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed4c004d40 0x7fed4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed6015fae0 con 0x7fed4c004d40 2024-09-10T09:23:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c00bb00 con 0x7fed4c003fe0 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c00bd00 con 0x7fed600b3840 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66b0a640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed4c004d40 0x7fed4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66309640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 0x7fed4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed65b08640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c003fe0 0x7fed4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66b0a640 1 -- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 msgr2=0x7fed4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66b0a640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed600b3840 0x7fed4c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66b0a640 1 -- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c003fe0 msgr2=0x7fed4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66b0a640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c003fe0 0x7fed4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.452+0000 7fed66b0a640 1 -- 172.21.15.12:0/227003517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c003520 con 0x7fed4c004d40 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed66b0a640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed4c004d40 0x7fed4c0051c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed58007360 tx=0x7fed4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f7dee24eb6194d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58009be0 con 0x7fed4c004d40 2024-09-10T09:23:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58036600 con 0x7fed4c004d40 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed65307640 1 -- 172.21.15.12:0/227003517 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed580369d0 con 0x7fed4c004d40 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed6856d640 1 -- 172.21.15.12:0/227003517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed4c004d40 msgr2=0x7fed4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed6856d640 1 --2- 172.21.15.12:0/227003517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed4c004d40 0x7fed4c0051c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed58007360 tx=0x7fed4c005830 comp rx=0 tx=0).stop 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.453+0000 7fed66b0a640 1 -- 172.21.15.12:0/227003517 reap_dead start 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.454+0000 7fed6856d640 1 -- 172.21.15.12:0/227003517 shutdown_connections 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.454+0000 7fed6856d640 1 -- 172.21.15.12:0/227003517 >> 172.21.15.12:0/227003517 conn(0x7fed6006ce90 msgr2=0x7fed6006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.454+0000 7fed6856d640 1 -- 172.21.15.12:0/227003517 shutdown_connections 2024-09-10T09:23:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.454+0000 7fed6856d640 1 -- 172.21.15.12:0/227003517 wait complete. 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.455+0000 7fed6856d640 1 Processor -- start 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.455+0000 7fed6856d640 1 -- start start 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.455+0000 7fed6856d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c004d40 0x7fed6015b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed6015a210 0x7fed60160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 0x7fed601613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed600b2de0 con 0x7fed60155260 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fed6015f2c0 con 0x7fed4c004d40 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fed6006bba0 con 0x7fed6015a210 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 0x7fed601613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 0x7fed601613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44682/0 (socket says 172.21.15.12:44682) 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 -- 172.21.15.12:0/378376032 learned_addr learned my addr 172.21.15.12:0/378376032 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed65b08640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed6015a210 0x7fed60160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66309640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c004d40 0x7fed6015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 -- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed6015a210 msgr2=0x7fed60160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed6015a210 0x7fed60160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 -- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c004d40 msgr2=0x7fed6015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c004d40 0x7fed6015b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 -- 172.21.15.12:0/378376032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6015bc60 con 0x7fed60155260 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed66b0a640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 0x7fed601613d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fed58007450 tx=0x7fed58004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58045070 con 0x7fed60155260 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58003990 con 0x7fed60155260 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6015b980 con 0x7fed60155260 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58009be0 con 0x7fed60155260 2024-09-10T09:23:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.456+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed601f5840 con 0x7fed60155260 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.457+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed600b3300 con 0x7fed60155260 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.458+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fed58048070 con 0x7fed60155260 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.458+0000 7fed56ffd640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fed4406bfe0 0x7fed4406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.458+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fed580ab600 con 0x7fed60155260 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.459+0000 7fed66309640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fed4406bfe0 0x7fed4406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.459+0000 7fed66309640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fed4406bfe0 0x7fed4406e4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed600b28b0 tx=0x7fed5c0078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.463+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed5803d070 con 0x7fed60155260 2024-09-10T09:23:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.675+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed600af660 con 0x7fed60155260 2024-09-10T09:23:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.676+0000 7fed56ffd640 1 -- 172.21.15.12:0/378376032 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5223 (secure 0 0 0) 0x7fed58032030 con 0x7fed60155260 2024-09-10T09:23:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:33.677 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"btime":"2024-09-10T09:23:27:299655+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T09:23:14.438605+0000","modified":"2024-09-10T09:23:16.449169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4714":{"gid":4714,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6836/694322310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":694322310},{"type":"v1","addr":"172.21.15.100:6836","nonce":694322310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4714,"qdb_cluster":[4714]},"id":2}]} 2024-09-10T09:23:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 15 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fed4406bfe0 msgr2=0x7fed4406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fed4406bfe0 0x7fed4406e4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed600b28b0 tx=0x7fed5c0078f0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 msgr2=0x7fed601613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 0x7fed601613d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fed58007450 tx=0x7fed58004ab0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 shutdown_connections 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fed4406bfe0 0x7fed4406e4a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed60155260 0x7fed601613d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed6015a210 0x7fed60160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 --2- 172.21.15.12:0/378376032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed4c004d40 0x7fed6015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 >> 172.21.15.12:0/378376032 conn(0x7fed6006ce90 msgr2=0x7fed6006f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 shutdown_connections 2024-09-10T09:23:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.678+0000 7fed6856d640 1 -- 172.21.15.12:0/378376032 wait complete. 2024-09-10T09:23:33.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.791+0000 7ff9a705c640 1 Processor -- start 2024-09-10T09:23:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.791+0000 7ff9a705c640 1 -- start start 2024-09-10T09:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a705c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a00b61f0 0x7ff9a00b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a705c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9a00b7aa0 0x7ff9a00b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a705c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a00b6b50 con 0x7ff9a015e860 2024-09-10T09:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a705c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a00d34d0 con 0x7ff9a00b7aa0 2024-09-10T09:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a705c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a00d3790 con 0x7ff9a00b61f0 2024-09-10T09:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9a00b7aa0 0x7ff9a00b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9a00b7aa0 0x7ff9a00b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44684/0 (socket says 172.21.15.12:44684) 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 -- 172.21.15.12:0/2070368270 learned_addr learned my addr 172.21.15.12:0/2070368270 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff997fff640 1 --2- 172.21.15.12:0/2070368270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a00b61f0 0x7ff9a00b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 -- 172.21.15.12:0/2070368270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a00b61f0 msgr2=0x7ff9a00b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 --2- 172.21.15.12:0/2070368270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a00b61f0 0x7ff9a00b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 -- 172.21.15.12:0/2070368270 >> v1:172.21.15.100:6789/0 conn(0x7ff9a015e860 legacy=0x7ff9a00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.792+0000 7ff9a55f9640 1 -- 172.21.15.12:0/2070368270 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a00d3a70 con 0x7ff9a00b7aa0 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.793+0000 7ff9a55f9640 1 --2- 172.21.15.12:0/2070368270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00b7ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff998009e50 tx=0x7ff99802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c5cf812c5fa936 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.793+0000 7ff9977fe640 1 -- 172.21.15.12:0/2070368270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998036070 con 0x7ff9a00b7aa0 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.793+0000 7ff9977fe640 1 -- 172.21.15.12:0/2070368270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff998031600 con 0x7ff9a00b7aa0 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.793+0000 7ff9977fe640 1 -- 172.21.15.12:0/2070368270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9980319d0 con 0x7ff9a00b7aa0 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 -- 172.21.15.12:0/2070368270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b7aa0 msgr2=0x7ff9a00b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2070368270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00b7ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff998009e50 tx=0x7ff99802a7a0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 -- 172.21.15.12:0/2070368270 shutdown_connections 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2070368270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00b7ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2070368270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a00b61f0 0x7ff9a00b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 -- 172.21.15.12:0/2070368270 >> 172.21.15.12:0/2070368270 conn(0x7ff9a0062c60 msgr2=0x7ff9a00d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 -- 172.21.15.12:0/2070368270 shutdown_connections 2024-09-10T09:23:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.794+0000 7ff9a705c640 1 -- 172.21.15.12:0/2070368270 wait complete. 2024-09-10T09:23:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.795+0000 7ff9a705c640 1 Processor -- start 2024-09-10T09:23:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.795+0000 7ff9a705c640 1 -- start start 2024-09-10T09:23:33.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a705c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 0x7ff9a015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a705c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a705c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a015e860 0x7ff9a00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a705c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a00d4310 con 0x7ff9a00b61f0 2024-09-10T09:23:33.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a705c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a00d4030 con 0x7ff9a00b7aa0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a705c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a015ec40 con 0x7ff9a015e860 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 0x7ff9a015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 0x7ff9a015bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44698/0 (socket says 172.21.15.12:44698) 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 -- 172.21.15.12:0/2804698884 learned_addr learned my addr 172.21.15.12:0/2804698884 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a55f9640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a015e860 0x7ff9a00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff997fff640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 -- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a015e860 msgr2=0x7ff9a00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a015e860 0x7ff9a00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 -- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9a00b7aa0 msgr2=0x7ff9a00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.796+0000 7ff9a4df8640 1 -- 172.21.15.12:0/2804698884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a015c1c0 con 0x7ff9a00b61f0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.797+0000 7ff9a4df8640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 0x7ff9a015bc80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00c400 tx=0x7ff99c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.797+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c017070 con 0x7ff9a00b61f0 2024-09-10T09:23:33.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.797+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c0052d0 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.797+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a00cb9c0 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.797+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c003830 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.797+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a00cbf80 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.798+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a00b3ad0 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.798+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff99c01a070 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.799+0000 7ff9957fa640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff98c06c010 0x7ff98c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.799+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff99c08a430 con 0x7ff9a00b61f0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.799+0000 7ff997fff640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff98c06c010 0x7ff98c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.800+0000 7ff997fff640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff98c06c010 0x7ff98c06e4d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00cd230 tx=0x7ff990008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.803+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff99c058bf0 con 0x7ff9a00b61f0 2024-09-10T09:23:33.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.980+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9a00d2700 con 0x7ff9a00b61f0 2024-09-10T09:23:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.981+0000 7ff9957fa640 1 -- 172.21.15.12:0/2804698884 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16741 (secure 0 0 0) 0x7ff99c0584f0 con 0x7ff9a00b61f0 2024-09-10T09:23:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:33.982 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:16.100995+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T09:23:12.362255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T09:23:13.425491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:33.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff98c06c010 msgr2=0x7ff98c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff98c06c010 0x7ff98c06e4d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00cd230 tx=0x7ff990008040 comp rx=0 tx=0).stop 2024-09-10T09:23:33.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 msgr2=0x7ff9a015bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 0x7ff9a015bc80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00c400 tx=0x7ff99c00c8c0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 shutdown_connections 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff98c06c010 0x7ff98c06e4d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff9a015e860 0x7ff9a00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9a00b7aa0 0x7ff9a00cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 --2- 172.21.15.12:0/2804698884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a00b61f0 0x7ff9a015bc80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.983+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 >> 172.21.15.12:0/2804698884 conn(0x7ff9a0062c60 msgr2=0x7ff9a00b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.984+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 shutdown_connections 2024-09-10T09:23:33.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:33.984+0000 7ff9a705c640 1 -- 172.21.15.12:0/2804698884 wait complete. 2024-09-10T09:23:33.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T09:23:34.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:23:34.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:23:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.099+0000 7f1dac7cf640 1 Processor -- start 2024-09-10T09:23:34.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.099+0000 7f1dac7cf640 1 -- start start 2024-09-10T09:23:34.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1dac7cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1da415b5b0 0x7f1da40b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1dac7cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1da415f190 0x7f1da40cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1dac7cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da415fb70 con 0x7f1da415f5d0 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1dac7cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1da4160130 con 0x7f1da415f190 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1dac7cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1da415fe50 con 0x7f1da415b5b0 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1da415f190 0x7f1da40cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1da415f190 0x7f1da40cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44706/0 (socket says 172.21.15.12:44706) 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 -- 172.21.15.12:0/1080298317 learned_addr learned my addr 172.21.15.12:0/1080298317 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1daa56b640 1 --2- 172.21.15.12:0/1080298317 >> v2:172.21.15.100:3300/0 conn(0x7f1da415b5b0 0x7f1da40b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 -- 172.21.15.12:0/1080298317 >> v2:172.21.15.100:3300/0 conn(0x7f1da415b5b0 msgr2=0x7f1da40b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 --2- 172.21.15.12:0/1080298317 >> v2:172.21.15.100:3300/0 conn(0x7f1da415b5b0 0x7f1da40b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 -- 172.21.15.12:0/1080298317 >> v1:172.21.15.100:6789/0 conn(0x7f1da415f5d0 legacy=0x7f1da40729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.100+0000 7f1da9d6a640 1 -- 172.21.15.12:0/1080298317 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40721b0 con 0x7f1da415f190 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.101+0000 7f1da9d6a640 1 --2- 172.21.15.12:0/1080298317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415f190 0x7f1da40cdfb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1da406dd70 tx=0x7f1d9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1a7d524dcbed6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.101+0000 7f1da9569640 1 -- 172.21.15.12:0/1080298317 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98037070 con 0x7f1da415f190 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.101+0000 7f1da9569640 1 -- 172.21.15.12:0/1080298317 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98032440 con 0x7f1da415f190 2024-09-10T09:23:34.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.101+0000 7f1da9569640 1 -- 172.21.15.12:0/1080298317 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98032810 con 0x7f1da415f190 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 -- 172.21.15.12:0/1080298317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415f190 msgr2=0x7f1da40cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/1080298317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415f190 0x7f1da40cdfb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1da406dd70 tx=0x7f1d9802a230 comp rx=0 tx=0).stop 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 -- 172.21.15.12:0/1080298317 shutdown_connections 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/1080298317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415f190 0x7f1da40cdfb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/1080298317 >> v2:172.21.15.100:3300/0 conn(0x7f1da415b5b0 0x7f1da40b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 -- 172.21.15.12:0/1080298317 >> 172.21.15.12:0/1080298317 conn(0x7f1da40b32d0 msgr2=0x7f1da40b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 -- 172.21.15.12:0/1080298317 shutdown_connections 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.102+0000 7f1dac7cf640 1 -- 172.21.15.12:0/1080298317 wait complete. 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.103+0000 7f1dac7cf640 1 Processor -- start 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.103+0000 7f1dac7cf640 1 -- start start 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1dac7cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 0x7f1da4145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1dac7cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1da415f190 0x7f1da40b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1dac7cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1da415f5d0 0x7f1da414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1dac7cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40ceeb0 con 0x7f1da415b5b0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1dac7cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1da415b990 con 0x7f1da415f5d0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1dac7cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40cf030 con 0x7f1da415f190 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 0x7f1da4145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 0x7f1da4145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44718/0 (socket says 172.21.15.12:44718) 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 -- 172.21.15.12:0/751415726 learned_addr learned my addr 172.21.15.12:0/751415726 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daad6c640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1da415f5d0 0x7f1da414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1da9d6a640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1da415f190 0x7f1da40b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 -- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1da415f190 msgr2=0x7f1da40b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1da415f190 0x7f1da40b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 -- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1da415f5d0 msgr2=0x7f1da414ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1da415f5d0 0x7f1da414ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.104+0000 7f1daa56b640 1 -- 172.21.15.12:0/751415726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da414d2f0 con 0x7f1da415b5b0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.105+0000 7f1daa56b640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 0x7f1da4145810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1da000d800 tx=0x7f1da000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.105+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da000b6c0 con 0x7f1da415b5b0 2024-09-10T09:23:34.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.105+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da0019070 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.105+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da414d5d0 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.105+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da000ba80 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.105+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da414db90 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.106+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da40b3ec0 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.106+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1da000bc20 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.107+0000 7f1d96ffd640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d8806c010 0x7f1d8806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.107+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1da008b4c0 con 0x7f1da415b5b0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.107+0000 7f1da9d6a640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d8806c010 0x7f1d8806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.107+0000 7f1da9d6a640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d8806c010 0x7f1d8806e4d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d98034000 tx=0x7f1d9802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:34.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.111+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1da00595a0 con 0x7f1da415b5b0 2024-09-10T09:23:34.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.322+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1da414bf80 con 0x7f1da415b5b0 2024-09-10T09:23:34.323 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-10T09:23:34.323+0000 7f66a0124640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:23:34.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.330+0000 7f1d96ffd640 1 -- 172.21.15.12:0/751415726 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f1da005d8a0 con 0x7f1da415b5b0 2024-09-10T09:23:34.331 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T09:23:34.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d8806c010 msgr2=0x7f1d8806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d8806c010 0x7f1d8806e4d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d98034000 tx=0x7f1d9802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:34.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 msgr2=0x7f1da4145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 0x7f1da4145810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1da000d800 tx=0x7f1da000dcc0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 shutdown_connections 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f1d8806c010 0x7f1d8806e4d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1da415f5d0 0x7f1da414ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1da415f190 0x7f1da40b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 --2- 172.21.15.12:0/751415726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1da415b5b0 0x7f1da4145810 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 >> 172.21.15.12:0/751415726 conn(0x7f1da40b32d0 msgr2=0x7f1da40b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 shutdown_connections 2024-09-10T09:23:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.332+0000 7f1dac7cf640 1 -- 172.21.15.12:0/751415726 wait complete. 2024-09-10T09:23:34.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T09:23:34.377 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-09-10T09:23:34.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.448+0000 7f3685949640 1 Processor -- start 2024-09-10T09:23:34.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.448+0000 7f3685949640 1 -- start start 2024-09-10T09:23:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f3685949640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36800b3d50 0x7f368006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f3685949640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36800cf9a0 con 0x7f3680161e30 2024-09-10T09:23:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f3685949640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3680162210 con 0x7f36800b3290 2024-09-10T09:23:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f3685949640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f36800cfcf0 con 0x7f36800b3d50 2024-09-10T09:23:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f367e7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36800b3d50 0x7f368006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f367effd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3680161e30 0x7f36800d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53562/0 (socket says 172.21.15.12:53562) 2024-09-10T09:23:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.449+0000 7f367effd640 1 -- 172.21.15.12:0/3775848589 learned_addr learned my addr 172.21.15.12:0/3775848589 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.450+0000 7f367e7fc640 1 -- 172.21.15.12:0/3775848589 >> v1:172.21.15.100:6789/0 conn(0x7f36800b3290 legacy=0x7f36800b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.450+0000 7f367e7fc640 1 -- 172.21.15.12:0/3775848589 >> v1:172.21.15.12:6789/0 conn(0x7f3680161e30 legacy=0x7f36800d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.450+0000 7f367e7fc640 1 -- 172.21.15.12:0/3775848589 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36800d5210 con 0x7f36800b3d50 2024-09-10T09:23:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.450+0000 7f367dffb640 1 -- 172.21.15.12:0/3775848589 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242571558 0 0) 0x7f36800cf9a0 con 0x7f3680161e30 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.450+0000 7f367e7fc640 1 --2- 172.21.15.12:0/3775848589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36800b3d50 0x7f368006d8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36680097a0 tx=0x7f366802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1b9db5bfb1312d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f367dffb640 1 -- 172.21.15.12:0/3775848589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668037070 con 0x7f36800b3d50 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f367dffb640 1 -- 172.21.15.12:0/3775848589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3668032440 con 0x7f36800b3d50 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f367dffb640 1 -- 172.21.15.12:0/3775848589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668032810 con 0x7f36800b3d50 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 -- 172.21.15.12:0/3775848589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36800b3d50 msgr2=0x7f368006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 --2- 172.21.15.12:0/3775848589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36800b3d50 0x7f368006d8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36680097a0 tx=0x7f366802a1e0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 -- 172.21.15.12:0/3775848589 shutdown_connections 2024-09-10T09:23:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 --2- 172.21.15.12:0/3775848589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36800b3d50 0x7f368006d8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 -- 172.21.15.12:0/3775848589 >> 172.21.15.12:0/3775848589 conn(0x7f36800d1870 msgr2=0x7f36800d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 -- 172.21.15.12:0/3775848589 shutdown_connections 2024-09-10T09:23:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.451+0000 7f3685949640 1 -- 172.21.15.12:0/3775848589 wait complete. 2024-09-10T09:23:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.452+0000 7f3685949640 1 Processor -- start 2024-09-10T09:23:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 -- start start 2024-09-10T09:23:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36800b3290 0x7f368014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36800b3d50 0x7f368015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 0x7f368015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f368006de00 con 0x7f3680161e30 2024-09-10T09:23:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36800b3950 con 0x7f36800b3290 2024-09-10T09:23:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f3685949640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f368006df80 con 0x7f36800b3d50 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 0x7f368015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 0x7f368015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44736/0 (socket says 172.21.15.12:44736) 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.453+0000 7f367f7fe640 1 -- 172.21.15.12:0/1253577968 learned_addr learned my addr 172.21.15.12:0/1253577968 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367e7fc640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36800b3d50 0x7f368015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367effd640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36800b3290 0x7f368014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367f7fe640 1 -- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36800b3d50 msgr2=0x7f368015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367f7fe640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36800b3d50 0x7f368015ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367f7fe640 1 -- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36800b3290 msgr2=0x7f368014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367f7fe640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36800b3290 0x7f368014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367f7fe640 1 -- 172.21.15.12:0/1253577968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36800c8390 con 0x7f3680161e30 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f367f7fe640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 0x7f368015f380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f367800c410 tx=0x7f367800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678017070 con 0x7f3680161e30 2024-09-10T09:23:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3678005230 con 0x7f3680161e30 2024-09-10T09:23:34.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36800c8670 con 0x7f3680161e30 2024-09-10T09:23:34.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36780045e0 con 0x7f3680161e30 2024-09-10T09:23:34.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.454+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36800c8c30 con 0x7f3680161e30 2024-09-10T09:23:34.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.455+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368006d8c0 con 0x7f3680161e30 2024-09-10T09:23:34.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.456+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f367801a070 con 0x7f3680161e30 2024-09-10T09:23:34.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.456+0000 7f3677fff640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f366006bfe0 0x7f366006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:34.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.456+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f367808a440 con 0x7f3680161e30 2024-09-10T09:23:34.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.456+0000 7f367effd640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f366006bfe0 0x7f366006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:34.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.457+0000 7f367effd640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f366006bfe0 0x7f366006e4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f36700012e0 tx=0x7f3670005eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:34.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.460+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3678058ba0 con 0x7f3680161e30 2024-09-10T09:23:34.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:34.671+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f36800cf170 con 0x7f3680161e30 2024-09-10T09:23:35.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.337+0000 7f3677fff640 1 -- 172.21.15.12:0/1253577968 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f36780584a0 con 0x7f3680161e30 2024-09-10T09:23:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f366006bfe0 msgr2=0x7f366006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f366006bfe0 0x7f366006e4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f36700012e0 tx=0x7f3670005eb0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 msgr2=0x7f368015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 0x7f368015f380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f367800c410 tx=0x7f367800c8d0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 shutdown_connections 2024-09-10T09:23:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f366006bfe0 0x7f366006e4a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3680161e30 0x7f368015f380 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36800b3d50 0x7f368015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 --2- 172.21.15.12:0/1253577968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36800b3290 0x7f368014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.340+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 >> 172.21.15.12:0/1253577968 conn(0x7f36800d1870 msgr2=0x7f36800b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.341+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 shutdown_connections 2024-09-10T09:23:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.341+0000 7f3685949640 1 -- 172.21.15.12:0/1253577968 wait complete. 2024-09-10T09:23:35.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T09:23:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.471+0000 7f6d2c85e640 1 Processor -- start 2024-09-10T09:23:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.471+0000 7f6d2c85e640 1 -- start start 2024-09-10T09:23:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2c85e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d2815e770 0x7f6d280b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2c85e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6d280b3b40 0x7f6d280d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2c85e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d280d2320 con 0x7f6d280b6710 2024-09-10T09:23:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2c85e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2815eb50 con 0x7f6d2815e770 2024-09-10T09:23:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2c85e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6d280b6b60 con 0x7f6d280b3b40 2024-09-10T09:23:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d2815e770 0x7f6d280b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d2815e770 0x7f6d280b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44752/0 (socket says 172.21.15.12:44752) 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 -- 172.21.15.12:0/4053535942 learned_addr learned my addr 172.21.15.12:0/4053535942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 -- 172.21.15.12:0/4053535942 >> v2:172.21.15.100:3300/0 conn(0x7f6d280b3b40 msgr2=0x7f6d280d33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d26d9d640 1 --2- 172.21.15.12:0/4053535942 >> v2:172.21.15.100:3300/0 conn(0x7f6d280b3b40 0x7f6d280d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 --2- 172.21.15.12:0/4053535942 >> v2:172.21.15.100:3300/0 conn(0x7f6d280b3b40 0x7f6d280d33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 -- 172.21.15.12:0/4053535942 >> v1:172.21.15.100:6789/0 conn(0x7f6d280b6710 legacy=0x7f6d280b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.472+0000 7f6d2659c640 1 -- 172.21.15.12:0/4053535942 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d280d25e0 con 0x7f6d2815e770 2024-09-10T09:23:35.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.473+0000 7f6d2659c640 1 --2- 172.21.15.12:0/4053535942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d2815e770 0x7f6d280b61d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d28162150 tx=0x7f6d1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c053413eb2772d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:35.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.473+0000 7f6d25d9b640 1 -- 172.21.15.12:0/4053535942 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18037070 con 0x7f6d2815e770 2024-09-10T09:23:35.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.473+0000 7f6d25d9b640 1 -- 172.21.15.12:0/4053535942 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18032440 con 0x7f6d2815e770 2024-09-10T09:23:35.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.473+0000 7f6d25d9b640 1 -- 172.21.15.12:0/4053535942 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18032810 con 0x7f6d2815e770 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 -- 172.21.15.12:0/4053535942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d2815e770 msgr2=0x7f6d280b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/4053535942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d2815e770 0x7f6d280b61d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d28162150 tx=0x7f6d1802a1a0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 -- 172.21.15.12:0/4053535942 shutdown_connections 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/4053535942 >> v2:172.21.15.100:3300/0 conn(0x7f6d280b3b40 0x7f6d280d33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/4053535942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d2815e770 0x7f6d280b61d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 -- 172.21.15.12:0/4053535942 >> 172.21.15.12:0/4053535942 conn(0x7f6d28062a50 msgr2=0x7f6d28062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 -- 172.21.15.12:0/4053535942 shutdown_connections 2024-09-10T09:23:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.474+0000 7f6d2c85e640 1 -- 172.21.15.12:0/4053535942 wait complete. 2024-09-10T09:23:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.475+0000 7f6d2c85e640 1 Processor -- start 2024-09-10T09:23:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 -- start start 2024-09-10T09:23:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6d280b3b40 0x7f6d281f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 0x7f6d2815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2815e770 0x7f6d2815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280d2e80 con 0x7f6d280b6710 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280d2ba0 con 0x7f6d2815e770 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d2c85e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6d280b76a0 con 0x7f6d280b3b40 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d1dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 0x7f6d2815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d1dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 0x7f6d2815ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44764/0 (socket says 172.21.15.12:44764) 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.476+0000 7f6d1dd9b640 1 -- 172.21.15.12:0/3042541218 learned_addr learned my addr 172.21.15.12:0/3042541218 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d26d9d640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2815e770 0x7f6d2815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d2659c640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6d280b3b40 0x7f6d281f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1dd9b640 1 -- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6d280b3b40 msgr2=0x7f6d281f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1dd9b640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6d280b3b40 0x7f6d281f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1dd9b640 1 -- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2815e770 msgr2=0x7f6d2815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1dd9b640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2815e770 0x7f6d2815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1dd9b640 1 -- 172.21.15.12:0/3042541218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d281606d0 con 0x7f6d280b6710 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d2659c640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6d280b3b40 0x7f6d281f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d26d9d640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2815e770 0x7f6d2815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1dd9b640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 0x7f6d2815ff30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c440 tx=0x7f6d1000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10017070 con 0x7f6d280b6710 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d100035f0 con 0x7f6d280b6710 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100039e0 con 0x7f6d280b6710 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d281609b0 con 0x7f6d280b6710 2024-09-10T09:23:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.477+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d28160f70 con 0x7f6d280b6710 2024-09-10T09:23:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.478+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d280b61d0 con 0x7f6d280b6710 2024-09-10T09:23:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.479+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6d1001a070 con 0x7f6d280b6710 2024-09-10T09:23:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.479+0000 7f6d1f7fe640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6d0806bfe0 0x7f6d0806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.479+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f6d1008a560 con 0x7f6d280b6710 2024-09-10T09:23:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.479+0000 7f6d2659c640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6d0806bfe0 0x7f6d0806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.480+0000 7f6d2659c640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6d0806bfe0 0x7f6d0806e4a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d18034000 tx=0x7f6d1802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:35.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.483+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d10058c30 con 0x7f6d280b6710 2024-09-10T09:23:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:35.660+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d280b4770 con 0x7f6d280b6710 2024-09-10T09:23:36.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.339+0000 7f6d1f7fe640 1 -- 172.21.15.12:0/3042541218 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7f6d10058530 con 0x7f6d280b6710 2024-09-10T09:23:36.340 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-10T09:23:36.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6d0806bfe0 msgr2=0x7f6d0806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:36.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6d0806bfe0 0x7f6d0806e4a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d18034000 tx=0x7f6d1802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:36.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 msgr2=0x7f6d2815ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:36.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 0x7f6d2815ff30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c440 tx=0x7f6d1000c900 comp rx=0 tx=0).stop 2024-09-10T09:23:36.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 shutdown_connections 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6d0806bfe0 0x7f6d0806e4a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2815e770 0x7f6d2815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d280b6710 0x7f6d2815ff30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 --2- 172.21.15.12:0/3042541218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6d280b3b40 0x7f6d281f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 >> 172.21.15.12:0/3042541218 conn(0x7f6d28062a50 msgr2=0x7f6d280b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 shutdown_connections 2024-09-10T09:23:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.342+0000 7f6d2c85e640 1 -- 172.21.15.12:0/3042541218 wait complete. 2024-09-10T09:23:36.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T09:23:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.472+0000 7fb5582f1640 1 Processor -- start 2024-09-10T09:23:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.472+0000 7fb5582f1640 1 -- start start 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.473+0000 7fb5582f1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5500b6ff0 0x7fb550073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.473+0000 7fb5582f1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5500b73d0 0x7fb55015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.473+0000 7fb5582f1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5500b5600 con 0x7fb55015fab0 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.473+0000 7fb5582f1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb550073530 con 0x7fb5500b73d0 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.473+0000 7fb5582f1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb5500b58e0 con 0x7fb5500b6ff0 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.473+0000 7fb55588c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5500b73d0 0x7fb55015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55688e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb55015fab0 0x7fb550160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53566/0 (socket says 172.21.15.12:53566) 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55588c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5500b73d0 0x7fb55015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44778/0 (socket says 172.21.15.12:44778) 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55688e640 1 -- 172.21.15.12:0/2393644784 learned_addr learned my addr 172.21.15.12:0/2393644784 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55588c640 1 -- 172.21.15.12:0/2393644784 >> v2:172.21.15.100:3300/0 conn(0x7fb5500b6ff0 msgr2=0x7fb550073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55608d640 1 --2- 172.21.15.12:0/2393644784 >> v2:172.21.15.100:3300/0 conn(0x7fb5500b6ff0 0x7fb550073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55588c640 1 --2- 172.21.15.12:0/2393644784 >> v2:172.21.15.100:3300/0 conn(0x7fb5500b6ff0 0x7fb550073b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55508b640 1 -- 172.21.15.12:0/2393644784 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223529952 0 0) 0x7fb5500b5600 con 0x7fb55015fab0 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55588c640 1 -- 172.21.15.12:0/2393644784 >> v1:172.21.15.12:6789/0 conn(0x7fb55015fab0 legacy=0x7fb550160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55588c640 1 -- 172.21.15.12:0/2393644784 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5500b5bc0 con 0x7fb5500b73d0 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.474+0000 7fb55608d640 1 --2- 172.21.15.12:0/2393644784 >> v2:172.21.15.100:3300/0 conn(0x7fb5500b6ff0 0x7fb550073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:36.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb55588c640 1 --2- 172.21.15.12:0/2393644784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb55015f570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb55006f080 tx=0x7fb54402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a51a49e62ed9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb55508b640 1 -- 172.21.15.12:0/2393644784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544037070 con 0x7fb5500b73d0 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb55508b640 1 -- 172.21.15.12:0/2393644784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb544032440 con 0x7fb5500b73d0 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb55508b640 1 -- 172.21.15.12:0/2393644784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54402ae60 con 0x7fb5500b73d0 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb5582f1640 1 -- 172.21.15.12:0/2393644784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 msgr2=0x7fb55015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb5582f1640 1 --2- 172.21.15.12:0/2393644784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb55015f570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb55006f080 tx=0x7fb54402a110 comp rx=0 tx=0).stop 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb5582f1640 1 -- 172.21.15.12:0/2393644784 shutdown_connections 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.475+0000 7fb5582f1640 1 --2- 172.21.15.12:0/2393644784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb55015f570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.476+0000 7fb5582f1640 1 --2- 172.21.15.12:0/2393644784 >> v2:172.21.15.100:3300/0 conn(0x7fb5500b6ff0 0x7fb550073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.476+0000 7fb5582f1640 1 -- 172.21.15.12:0/2393644784 >> 172.21.15.12:0/2393644784 conn(0x7fb550062630 msgr2=0x7fb550062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.476+0000 7fb5582f1640 1 -- 172.21.15.12:0/2393644784 shutdown_connections 2024-09-10T09:23:36.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.476+0000 7fb5582f1640 1 -- 172.21.15.12:0/2393644784 wait complete. 2024-09-10T09:23:36.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.477+0000 7fb5582f1640 1 Processor -- start 2024-09-10T09:23:36.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.477+0000 7fb5582f1640 1 -- start start 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5500b6ff0 0x7fb550154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb5501539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb55015fab0 0x7fb550156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5500b6460 con 0x7fb5500b73d0 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5500b6180 con 0x7fb5500b6ff0 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb5500d1770 con 0x7fb55015fab0 2024-09-10T09:23:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb5501539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb5501539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44782/0 (socket says 172.21.15.12:44782) 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 -- 172.21.15.12:0/1505705549 learned_addr learned my addr 172.21.15.12:0/1505705549 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55608d640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5500b6ff0 0x7fb550154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55688e640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb55015fab0 0x7fb550156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 -- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb55015fab0 msgr2=0x7fb550156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb55015fab0 0x7fb550156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 -- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5500b6ff0 msgr2=0x7fb550154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5500b6ff0 0x7fb550154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 -- 172.21.15.12:0/1505705549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb550156230 con 0x7fb5500b73d0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55608d640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5500b6ff0 0x7fb550154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb55588c640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb5501539b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb544009890 tx=0x7fb5440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544037040 con 0x7fb5500b73d0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb544042070 con 0x7fb5500b73d0 2024-09-10T09:23:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb550159a10 con 0x7fb5500b73d0 2024-09-10T09:23:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.478+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544030a50 con 0x7fb5500b73d0 2024-09-10T09:23:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.479+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb550158f30 con 0x7fb5500b73d0 2024-09-10T09:23:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.480+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55015f570 con 0x7fb5500b73d0 2024-09-10T09:23:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.480+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb544030bf0 con 0x7fb5500b73d0 2024-09-10T09:23:36.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.480+0000 7fb54effd640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb53c06bfe0 0x7fb53c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:36.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.481+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7fb5440aba60 con 0x7fb5500b73d0 2024-09-10T09:23:36.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.481+0000 7fb55608d640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb53c06bfe0 0x7fb53c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:36.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.481+0000 7fb55608d640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb53c06bfe0 0x7fb53c06e4a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb54000e3d0 tx=0x7fb540007a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:36.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.485+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb544045360 con 0x7fb5500b73d0 2024-09-10T09:23:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:36.659+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb55015ef60 con 0x7fb5500b73d0 2024-09-10T09:23:37.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.343+0000 7fb54effd640 1 -- 172.21.15.12:0/1505705549 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7fb54407a380 con 0x7fb5500b73d0 2024-09-10T09:23:37.344 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb53c06bfe0 msgr2=0x7fb53c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb53c06bfe0 0x7fb53c06e4a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb54000e3d0 tx=0x7fb540007a10 comp rx=0 tx=0).stop 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 msgr2=0x7fb5501539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb5501539b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb544009890 tx=0x7fb5440046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 shutdown_connections 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb53c06bfe0 0x7fb53c06e4a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb55015fab0 0x7fb550156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5500b73d0 0x7fb5501539b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 --2- 172.21.15.12:0/1505705549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5500b6ff0 0x7fb550154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 >> 172.21.15.12:0/1505705549 conn(0x7fb550062630 msgr2=0x7fb550160640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 shutdown_connections 2024-09-10T09:23:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.346+0000 7fb5582f1640 1 -- 172.21.15.12:0/1505705549 wait complete. 2024-09-10T09:23:37.363 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T09:23:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.479+0000 7f7fef7c4640 1 Processor -- start 2024-09-10T09:23:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.480+0000 7f7fef7c4640 1 -- start start 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.480+0000 7f7fef7c4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 0x7f7fe80d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.480+0000 7f7fef7c4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7fe80b3d50 0x7f7fe806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.480+0000 7f7fef7c4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe80cf9a0 con 0x7f7fe80b3290 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.480+0000 7f7fef7c4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe80cfcf0 con 0x7f7fe80b3d50 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.480+0000 7f7fef7c4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe8162210 con 0x7f7fe8161e30 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fedd61640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7fe80b3290 0x7f7fe80b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53582/0 (socket says 172.21.15.12:53582) 2024-09-10T09:23:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fedd61640 1 -- 172.21.15.12:0/2455085125 learned_addr learned my addr 172.21.15.12:0/2455085125 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/2455085125 >> v2:172.21.15.100:3300/0 conn(0x7f7fe80b3d50 0x7f7fe806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fed560640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 0x7f7fe80d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292502856 0 0) 0x7f7fe80cf9a0 con 0x7f7fe80b3290 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd4003520 con 0x7f7fe80b3290 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1045880975 0 0) 0x7f7fd4003520 con 0x7f7fe80b3290 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 msgr2=0x7f7fe80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 0x7f7fe80d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 >> v2:172.21.15.100:3300/0 conn(0x7f7fe80b3d50 msgr2=0x7f7fe806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 --2- 172.21.15.12:0/2455085125 >> v2:172.21.15.100:3300/0 conn(0x7f7fe80b3d50 0x7f7fe806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe80d5210 con 0x7f7fe80b3290 2024-09-10T09:23:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f7fe00019f0 con 0x7f7fe80b3290 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 >> v1:172.21.15.12:6789/0 conn(0x7f7fe80b3290 legacy=0x7f7fe80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 0x7f7fd40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd4004d40 0x7f7fd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80cfcf0 con 0x7f7fd4003f30 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8162210 con 0x7f7fd4004d40 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd400b9c0 con 0x7f7fe8161e30 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.481+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fed560640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 0x7f7fd40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fedd61640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd4004d40 0x7f7fd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fecd5f640 1 -- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 msgr2=0x7f7fd40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:37.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe8161e30 0x7f7fd40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fecd5f640 1 -- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd4004d40 msgr2=0x7f7fd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd4004d40 0x7f7fd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fecd5f640 1 -- 172.21.15.12:0/2455085125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd4003520 con 0x7f7fd4003f30 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.482+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fd4004800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009a90 tx=0x7f7fd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee3864f5b7fe2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8036070 con 0x7f7fd4003f30 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd8031400 con 0x7f7fd4003f30 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fdffff640 1 -- 172.21.15.12:0/2455085125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8009690 con 0x7f7fd4003f30 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fef7c4640 1 -- 172.21.15.12:0/2455085125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 msgr2=0x7f7fd4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/2455085125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fd4004800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009a90 tx=0x7f7fd4005830 comp rx=0 tx=0).stop 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fedd61640 1 -- 172.21.15.12:0/2455085125 reap_dead start 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fef7c4640 1 -- 172.21.15.12:0/2455085125 shutdown_connections 2024-09-10T09:23:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fef7c4640 1 -- 172.21.15.12:0/2455085125 >> 172.21.15.12:0/2455085125 conn(0x7f7fe80d1870 msgr2=0x7f7fe80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:37.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fef7c4640 1 -- 172.21.15.12:0/2455085125 shutdown_connections 2024-09-10T09:23:37.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.483+0000 7f7fef7c4640 1 -- 172.21.15.12:0/2455085125 wait complete. 2024-09-10T09:23:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 Processor -- start 2024-09-10T09:23:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 -- start start 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fe8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe80b54b0 0x7f7fe8157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe80b65d0 0x7f7fe80b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe806de00 con 0x7f7fd4003f30 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80b3950 con 0x7f7fe80b54b0 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fef7c4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe806df80 con 0x7f7fe80b65d0 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fed560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fe8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fed560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fe8154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44814/0 (socket says 172.21.15.12:44814) 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.485+0000 7f7fed560640 1 -- 172.21.15.12:0/817434897 learned_addr learned my addr 172.21.15.12:0/817434897 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fedd61640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe80b65d0 0x7f7fe80b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe80b54b0 0x7f7fe8157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fed560640 1 -- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe80b65d0 msgr2=0x7f7fe80b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fed560640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe80b65d0 0x7f7fe80b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fed560640 1 -- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe80b54b0 msgr2=0x7f7fe8157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fed560640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe80b54b0 0x7f7fe8157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fed560640 1 -- 172.21.15.12:0/817434897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe81552a0 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fed560640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fe8154d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40119a0 tx=0x7f7fe4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400faf0 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe400fc90 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4014440 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe8156f40 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.486+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe80b4410 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.487+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe815d590 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.488+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f7fe4012040 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.488+0000 7f7fddffb640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7fcc06c010 0x7f7fcc06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.489+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f7fe408b2e0 con 0x7f7fd4003f30 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.489+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7fcc06c010 0x7f7fcc06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.489+0000 7f7fecd5f640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7fcc06c010 0x7f7fcc06e4d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8033000 tx=0x7f7fd8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.493+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fe81552a0 con 0x7f7fd4003f30 2024-09-10T09:23:37.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.667+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f7fe815e110 con 0x7f7fd4003f30 2024-09-10T09:23:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.670+0000 7f7fddffb640 1 -- 172.21.15.12:0/817434897 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f7fe4019030 con 0x7f7fd4003f30 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7fcc06c010 msgr2=0x7f7fcc06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7fcc06c010 0x7f7fcc06e4d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8033000 tx=0x7f7fd8008030 comp rx=0 tx=0).stop 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 msgr2=0x7f7fe8154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fe8154d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40119a0 tx=0x7f7fe4011e60 comp rx=0 tx=0).stop 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 shutdown_connections 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f7fcc06c010 0x7f7fcc06e4d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7fe80b65d0 0x7f7fe80b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fe80b54b0 0x7f7fe8157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 --2- 172.21.15.12:0/817434897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fd4003f30 0x7f7fe8154d60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 >> 172.21.15.12:0/817434897 conn(0x7f7fe80d1870 msgr2=0x7f7fe80b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 shutdown_connections 2024-09-10T09:23:37.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.673+0000 7f7fef7c4640 1 -- 172.21.15.12:0/817434897 wait complete. 2024-09-10T09:23:37.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-10T09:23:37.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.786+0000 7f8cbac4c640 1 Processor -- start 2024-09-10T09:23:37.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.786+0000 7f8cbac4c640 1 -- start start 2024-09-10T09:23:37.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cbac4c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8cb40b61f0 0x7f8cb40b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cbac4c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb40d34d0 con 0x7f8cb415e860 2024-09-10T09:23:37.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cbac4c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb40d3790 con 0x7f8cb40b7aa0 2024-09-10T09:23:37.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cbac4c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb40b6b80 con 0x7f8cb40b61f0 2024-09-10T09:23:37.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cb89e8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8cb415e860 0x7f8cb40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53584/0 (socket says 172.21.15.12:53584) 2024-09-10T09:23:37.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cb89e8640 1 -- 172.21.15.12:0/1993491576 learned_addr learned my addr 172.21.15.12:0/1993491576 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:37.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cb3fff640 1 --2- 172.21.15.12:0/1993491576 >> v2:172.21.15.100:3300/0 conn(0x7f8cb40b61f0 0x7f8cb40b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168587429 0 0) 0x7f8cb40d34d0 con 0x7f8cb415e860 2024-09-10T09:23:37.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.787+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c9c003520 con 0x7f8cb415e860 2024-09-10T09:23:37.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.788+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181290915 0 0) 0x7f8cb40d3790 con 0x7f8cb40b7aa0 2024-09-10T09:23:37.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.788+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb40d34d0 con 0x7f8cb40b7aa0 2024-09-10T09:23:37.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.788+0000 7f8cb3fff640 1 -- 172.21.15.12:0/1993491576 >> v1:172.21.15.100:6789/0 conn(0x7f8cb40b7aa0 legacy=0x7f8cb40b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.788+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2528559239 0 0) 0x7f8c9c003520 con 0x7f8cb415e860 2024-09-10T09:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.788+0000 7f8cb3fff640 1 -- 172.21.15.12:0/1993491576 >> v1:172.21.15.12:6789/0 conn(0x7f8cb415e860 legacy=0x7f8cb40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.788+0000 7f8cb3fff640 1 -- 172.21.15.12:0/1993491576 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb40d3a70 con 0x7f8cb40b61f0 2024-09-10T09:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cb3fff640 1 --2- 172.21.15.12:0/1993491576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40b6640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80097a0 tx=0x7f8ca802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c24e4ad03cbf9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8037070 con 0x7f8cb40b61f0 2024-09-10T09:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca802ace0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cb37fe640 1 -- 172.21.15.12:0/1993491576 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4001670 con 0x7f8cb40b61f0 2024-09-10T09:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 -- 172.21.15.12:0/1993491576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b61f0 msgr2=0x7f8cb40b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/1993491576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40b6640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80097a0 tx=0x7f8ca802a250 comp rx=0 tx=0).stop 2024-09-10T09:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 -- 172.21.15.12:0/1993491576 shutdown_connections 2024-09-10T09:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/1993491576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40b6640 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 -- 172.21.15.12:0/1993491576 >> 172.21.15.12:0/1993491576 conn(0x7f8cb4062c60 msgr2=0x7f8cb40d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 -- 172.21.15.12:0/1993491576 shutdown_connections 2024-09-10T09:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.789+0000 7f8cbac4c640 1 -- 172.21.15.12:0/1993491576 wait complete. 2024-09-10T09:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 Processor -- start 2024-09-10T09:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 -- start start 2024-09-10T09:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b7aa0 0x7f8cb40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8cb415e860 0x7f8cb41f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40d4310 con 0x7f8cb40b61f0 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.791+0000 7f8cbac4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40d4030 con 0x7f8cb40b7aa0 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cbac4c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb415ec40 con 0x7f8cb415e860 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44826/0 (socket says 172.21.15.12:44826) 2024-09-10T09:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 -- 172.21.15.12:0/2191531436 learned_addr learned my addr 172.21.15.12:0/2191531436 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb3fff640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b7aa0 0x7f8cb40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb91e9640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8cb415e860 0x7f8cb41f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 -- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8cb415e860 msgr2=0x7f8cb41f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8cb415e860 0x7f8cb41f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 -- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b7aa0 msgr2=0x7f8cb40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b7aa0 0x7f8cb40cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 -- 172.21.15.12:0/2191531436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb40cc8c0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb89e8640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40cdb20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c520 tx=0x7f8ca400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4017070 con 0x7f8cb40b61f0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca4005ce0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40072b0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb40ccba0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.792+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41f54b0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.793+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb40b3ad0 con 0x7f8cb40b61f0 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.794+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f8ca401a070 con 0x7f8cb40b61f0 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.794+0000 7f8cb17fa640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ca006bfe0 0x7f8ca006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.794+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f8ca408a160 con 0x7f8cb40b61f0 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.795+0000 7f8cb3fff640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ca006bfe0 0x7f8ca006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.795+0000 7f8cb3fff640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ca006bfe0 0x7f8ca006e4a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8034000 tx=0x7f8ca802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:37.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:37.799+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ca4058680 con 0x7f8cb40b61f0 2024-09-10T09:23:38.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.041+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f8cb40d2700 con 0x7f8cb40b61f0 2024-09-10T09:23:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.344+0000 7f8cb17fa640 1 -- 172.21.15.12:0/2191531436 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v78) ==== 167+0+0 (secure 0 0 0) 0x7f8ca405c980 con 0x7f8cb40b61f0 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ca006bfe0 msgr2=0x7f8ca006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ca006bfe0 0x7f8ca006e4a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8034000 tx=0x7f8ca802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 msgr2=0x7f8cb40cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40cdb20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c520 tx=0x7f8ca400c9e0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 shutdown_connections 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8ca006bfe0 0x7f8ca006e4a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8cb415e860 0x7f8cb41f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cb40b7aa0 0x7f8cb40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 --2- 172.21.15.12:0/2191531436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cb40b61f0 0x7f8cb40cdb20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 >> 172.21.15.12:0/2191531436 conn(0x7f8cb4062c60 msgr2=0x7f8cb40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 shutdown_connections 2024-09-10T09:23:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.347+0000 7f8cbac4c640 1 -- 172.21.15.12:0/2191531436 wait complete. 2024-09-10T09:23:38.359 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2024-09-10T09:23:38.359 INFO:tasks.cephfs_test_runner: 2024-09-10T09:23:38.359 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T09:23:38.360 INFO:tasks.cephfs_test_runner:Ran 1 test in 40.163s 2024-09-10T09:23:38.360 INFO:tasks.cephfs_test_runner: 2024-09-10T09:23:38.360 INFO:tasks.cephfs_test_runner:OK 2024-09-10T09:23:38.360 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T09:23:38.369 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T09:23:38.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:38.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.505+0000 7f6f226d0640 1 Processor -- start 2024-09-10T09:23:38.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.505+0000 7f6f226d0640 1 -- start start 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.506+0000 7f6f226d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f1c15e940 0x7f6f1c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.506+0000 7f6f226d0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c0b7170 con 0x7f6f1c15ed20 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.506+0000 7f6f226d0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c0b7aa0 con 0x7f6f1c0cef90 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.506+0000 7f6f226d0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1c0d3660 con 0x7f6f1c15e940 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.506+0000 7f6f1b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6f1c15ed20 0x7f6f1c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53586/0 (socket says 172.21.15.12:53586) 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.506+0000 7f6f1b7fe640 1 -- 172.21.15.12:0/450459817 learned_addr learned my addr 172.21.15.12:0/450459817 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/450459817 >> v2:172.21.15.100:3300/0 conn(0x7f6f1c15e940 0x7f6f1c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322437527 0 0) 0x7f6f10001110 con 0x7f6f1c15ed20 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f04003520 con 0x7f6f1c15ed20 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 380383301 0 0) 0x7f6f04003520 con 0x7f6f1c15ed20 2024-09-10T09:23:38.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 >> v2:172.21.15.100:3300/0 conn(0x7f6f1c15e940 msgr2=0x7f6f1c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 --2- 172.21.15.12:0/450459817 >> v2:172.21.15.100:3300/0 conn(0x7f6f1c15e940 0x7f6f1c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 >> v1:172.21.15.100:6789/0 conn(0x7f6f1c0cef90 legacy=0x7f6f1c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c0d3940 con 0x7f6f1c15ed20 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f6f10001840 con 0x7f6f1c15ed20 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 >> v1:172.21.15.12:6789/0 conn(0x7f6f1c15ed20 legacy=0x7f6f1c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f040039b0 0x7f6f04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f04004800 0x7f6f04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f040051c0 0x7f6f0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d3660 con 0x7f6f04004800 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0400c070 con 0x7f6f040051c0 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0400c270 con 0x7f6f040039b0 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1b7fe640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f04004800 0x7f6f04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f040039b0 0x7f6f04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.507+0000 7f6f20c6d640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f040051c0 0x7f6f0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1b7fe640 1 -- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f040039b0 msgr2=0x7f6f04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1b7fe640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f040039b0 0x7f6f04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1b7fe640 1 -- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f040051c0 msgr2=0x7f6f0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1b7fe640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f040051c0 0x7f6f0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1b7fe640 1 -- 172.21.15.12:0/450459817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f04003520 con 0x7f6f04004800 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f20c6d640 1 -- 172.21.15.12:0/450459817 reap_dead start 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1b7fe640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f04004800 0x7f6f04004c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c490 tx=0x7f6f04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5adf37027de09a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.508+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000c0e0 con 0x7f6f04004800 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f10034070 con 0x7f6f04004800 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f1affd640 1 -- 172.21.15.12:0/450459817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10005d70 con 0x7f6f04004800 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 -- 172.21.15.12:0/450459817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f04004800 msgr2=0x7f6f04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f04004800 0x7f6f04004c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c490 tx=0x7f6f04005830 comp rx=0 tx=0).stop 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 -- 172.21.15.12:0/450459817 shutdown_connections 2024-09-10T09:23:38.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 --2- 172.21.15.12:0/450459817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f04004800 0x7f6f04004c80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 -- 172.21.15.12:0/450459817 >> 172.21.15.12:0/450459817 conn(0x7f6f1c0b6240 msgr2=0x7f6f1c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:38.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 -- 172.21.15.12:0/450459817 shutdown_connections 2024-09-10T09:23:38.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.509+0000 7f6f226d0640 1 -- 172.21.15.12:0/450459817 wait complete. 2024-09-10T09:23:38.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.510+0000 7f6f226d0640 1 Processor -- start 2024-09-10T09:23:38.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.510+0000 7f6f226d0640 1 -- start start 2024-09-10T09:23:38.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f226d0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f04004800 0x7f6f1c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f226d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f1c15c310 0x7f6f1c0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f226d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 0x7f6f1c15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f226d0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d1ef0 con 0x7f6f1c156750 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f226d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d3f00 con 0x7f6f1c15c310 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f226d0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d2070 con 0x7f6f04004800 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f20c6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 0x7f6f1c15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f20c6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 0x7f6f1c15b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44834/0 (socket says 172.21.15.12:44834) 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f20c6d640 1 -- 172.21.15.12:0/2920046929 learned_addr learned my addr 172.21.15.12:0/2920046929 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f1b7fe640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f1c15c310 0x7f6f1c0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.511+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f04004800 0x7f6f1c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f20c6d640 1 -- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f04004800 msgr2=0x7f6f1c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f20c6d640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f04004800 0x7f6f1c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f20c6d640 1 -- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f1c15c310 msgr2=0x7f6f1c0caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f20c6d640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f1c15c310 0x7f6f1c0caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f20c6d640 1 -- 172.21.15.12:0/2920046929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c1f52c0 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f20c6d640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 0x7f6f1c15b580 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c15f100 tx=0x7f6f1400fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1401a070 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f14006d60 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c1f55a0 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14003bb0 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.512+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c15b060 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.513+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1c15b260 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.514+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6f1401d070 con 0x7f6f1c156750 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.514+0000 7f6f18ff9640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0806bfe0 0x7f6f0806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.514+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f6f1408a2a0 con 0x7f6f1c156750 2024-09-10T09:23:38.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.514+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0806bfe0 0x7f6f0806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.515+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0806bfe0 0x7f6f0806e4a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c15c2a0 tx=0x7f6f0c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:38.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.518+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f1c15b260 con 0x7f6f1c156750 2024-09-10T09:23:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.695+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f1c0d10f0 con 0x7f6f1c156750 2024-09-10T09:23:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.696+0000 7f6f18ff9640 1 -- 172.21.15.12:0/2920046929 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13044 (secure 0 0 0) 0x7f6f14058710 con 0x7f6f1c156750 2024-09-10T09:23:38.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:38.697 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:37.339968+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6836/694322310":"2024-09-11T09:23:34.323641+0000","172.21.15.100:6834/694322310":"2024-09-11T09:23:34.323641+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0806bfe0 msgr2=0x7f6f0806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0806bfe0 0x7f6f0806e4a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c15c2a0 tx=0x7f6f0c009190 comp rx=0 tx=0).stop 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 msgr2=0x7f6f1c15b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 0x7f6f1c15b580 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c15f100 tx=0x7f6f1400fbd0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 shutdown_connections 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6f0806bfe0 0x7f6f0806e4a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f1c156750 0x7f6f1c15b580 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f1c15c310 0x7f6f1c0caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 --2- 172.21.15.12:0/2920046929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f04004800 0x7f6f1c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 >> 172.21.15.12:0/2920046929 conn(0x7f6f1c0b6240 msgr2=0x7f6f1c15f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:38.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 shutdown_connections 2024-09-10T09:23:38.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.698+0000 7f6f226d0640 1 -- 172.21.15.12:0/2920046929 wait complete. 2024-09-10T09:23:38.710 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T09:22:27.264704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T09:23:38.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T09:23:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.814+0000 7f82e0111640 1 Processor -- start 2024-09-10T09:23:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.814+0000 7f82e0111640 1 -- start start 2024-09-10T09:23:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82e0111640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82d8148020 0x7f82d80b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82e0111640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82e0111640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d8148400 con 0x7f82d80b4b90 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82e0111640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f82d80b5ff0 con 0x7f82d8148020 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82e0111640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f82d80af250 con 0x7f82d80ae8e0 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82ddead640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82d8148020 0x7f82d80b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82ddead640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82d8148020 0x7f82d80b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44838/0 (socket says 172.21.15.12:44838) 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.815+0000 7f82ddead640 1 -- 172.21.15.12:0/2324341149 learned_addr learned my addr 172.21.15.12:0/2324341149 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82de6ae640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82ddead640 1 -- 172.21.15.12:0/2324341149 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 msgr2=0x7f82d80aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82ddead640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d80aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82ddead640 1 -- 172.21.15.12:0/2324341149 >> v1:172.21.15.100:6789/0 conn(0x7f82d80b4b90 legacy=0x7f82d80b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82ddead640 1 -- 172.21.15.12:0/2324341149 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d80b53e0 con 0x7f82d8148020 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82de6ae640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d80aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.816+0000 7f82ddead640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d8148020 0x7f82d80b0b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82d8072ef0 tx=0x7f82c802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82871c5bde935661 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82dceab640 1 -- 172.21.15.12:0/2324341149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8036070 con 0x7f82d8148020 2024-09-10T09:23:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82dceab640 1 -- 172.21.15.12:0/2324341149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c8031600 con 0x7f82d8148020 2024-09-10T09:23:38.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82dceab640 1 -- 172.21.15.12:0/2324341149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c80319d0 con 0x7f82d8148020 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 -- 172.21.15.12:0/2324341149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d8148020 msgr2=0x7f82d80b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d8148020 0x7f82d80b0b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82d8072ef0 tx=0x7f82c802a6a0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 -- 172.21.15.12:0/2324341149 shutdown_connections 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d80aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 --2- 172.21.15.12:0/2324341149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d8148020 0x7f82d80b0b30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 -- 172.21.15.12:0/2324341149 >> 172.21.15.12:0/2324341149 conn(0x7f82d806d0d0 msgr2=0x7f82d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 -- 172.21.15.12:0/2324341149 shutdown_connections 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.817+0000 7f82e0111640 1 -- 172.21.15.12:0/2324341149 wait complete. 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.818+0000 7f82e0111640 1 Processor -- start 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 -- start start 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 0x7f82d80c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82d8148020 0x7f82d81607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f82d80b5c80 con 0x7f82d80b4b90 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f82d80b59a0 con 0x7f82d8148020 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82e0111640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f82d80b5000 con 0x7f82d80ae8e0 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82dd6ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 0x7f82d80c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82dd6ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 0x7f82d80c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44846/0 (socket says 172.21.15.12:44846) 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82dd6ac640 1 -- 172.21.15.12:0/2603079778 learned_addr learned my addr 172.21.15.12:0/2603079778 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82ddead640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.819+0000 7f82de6ae640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82d8148020 0x7f82d81607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82dd6ac640 1 -- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 msgr2=0x7f82d815e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82dd6ac640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d815e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82dd6ac640 1 -- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82d8148020 msgr2=0x7f82d81607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82dd6ac640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82d8148020 0x7f82d81607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82dd6ac640 1 -- 172.21.15.12:0/2603079778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d8143d80 con 0x7f82d80b4b90 2024-09-10T09:23:38.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82dd6ac640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 0x7f82d80c71f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c430 tx=0x7f82cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc011790 con 0x7f82d80b4b90 2024-09-10T09:23:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc017070 con 0x7f82d80b4b90 2024-09-10T09:23:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d8144060 con 0x7f82d80b4b90 2024-09-10T09:23:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc011bb0 con 0x7f82d80b4b90 2024-09-10T09:23:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.820+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d8144620 con 0x7f82d80b4b90 2024-09-10T09:23:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.821+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80aed10 con 0x7f82d80b4b90 2024-09-10T09:23:38.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.822+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f82cc01c460 con 0x7f82d80b4b90 2024-09-10T09:23:38.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.822+0000 7f82d67fc640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f82c406bfe0 0x7f82c406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:38.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.823+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f82cc08ac10 con 0x7f82d80b4b90 2024-09-10T09:23:38.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.823+0000 7f82ddead640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f82c406bfe0 0x7f82c406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:38.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.823+0000 7f82ddead640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f82c406bfe0 0x7f82c406e4a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f82c8033000 tx=0x7f82c8009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:38.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:38.827+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82cc058ff0 con 0x7f82d80b4b90 2024-09-10T09:23:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.002+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82d80b1ba0 con 0x7f82d80b4b90 2024-09-10T09:23:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.003+0000 7f82d67fc640 1 -- 172.21.15.12:0/2603079778 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f82cc05d2f0 con 0x7f82d80b4b90 2024-09-10T09:23:39.003 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-10T09:23:39.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f82c406bfe0 msgr2=0x7f82c406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:39.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f82c406bfe0 0x7f82c406e4a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f82c8033000 tx=0x7f82c8009000 comp rx=0 tx=0).stop 2024-09-10T09:23:39.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 msgr2=0x7f82d80c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:39.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 0x7f82d80c71f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c430 tx=0x7f82cc00c8f0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 shutdown_connections 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f82c406bfe0 0x7f82c406e4a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82d8148020 0x7f82d81607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82d80b4b90 0x7f82d80c71f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 --2- 172.21.15.12:0/2603079778 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82d80ae8e0 0x7f82d815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.004+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 >> 172.21.15.12:0/2603079778 conn(0x7f82d806d0d0 msgr2=0x7f82d806f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.005+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 shutdown_connections 2024-09-10T09:23:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.005+0000 7f82e0111640 1 -- 172.21.15.12:0/2603079778 wait complete. 2024-09-10T09:23:39.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T09:23:39.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.117+0000 7f511436d640 1 Processor -- start 2024-09-10T09:23:39.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.117+0000 7f511436d640 1 -- start start 2024-09-10T09:23:39.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f511436d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f510c148330 0x7f510c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:39.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f511436d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c15fbf0 con 0x7f510c15f5d0 2024-09-10T09:23:39.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f511436d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c0b4f80 con 0x7f510c06c0e0 2024-09-10T09:23:39.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f511436d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f510c06c520 con 0x7f510c148330 2024-09-10T09:23:39.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f5112109640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f510c148330 0x7f510c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f511290a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f510c15f5d0 0x7f510c0b5d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53600/0 (socket says 172.21.15.12:53600) 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f511290a640 1 -- 172.21.15.12:0/829581508 learned_addr learned my addr 172.21.15.12:0/829581508 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.118+0000 7f5112109640 1 --2- 172.21.15.12:0/829581508 >> v2:172.21.15.12:3300/0 conn(0x7f510c148330 0x7f510c06bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44858/0 (socket says 172.21.15.12:44858) 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.119+0000 7f5112109640 1 -- 172.21.15.12:0/829581508 >> v1:172.21.15.100:6789/0 conn(0x7f510c06c0e0 legacy=0x7f510c15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.119+0000 7f5112109640 1 -- 172.21.15.12:0/829581508 >> v1:172.21.15.12:6789/0 conn(0x7f510c15f5d0 legacy=0x7f510c0b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.119+0000 7f5112109640 1 -- 172.21.15.12:0/829581508 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c0b5260 con 0x7f510c148330 2024-09-10T09:23:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.119+0000 7f5111107640 1 -- 172.21.15.12:0/829581508 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685056423 0 0) 0x7f510c15fbf0 con 0x7f510c15f5d0 2024-09-10T09:23:39.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.119+0000 7f5112109640 1 --2- 172.21.15.12:0/829581508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c06bba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009d90 tx=0x7f50fc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7456e41597d6ae4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:39.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f5111107640 1 -- 172.21.15.12:0/829581508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc031600 con 0x7f510c148330 2024-09-10T09:23:39.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f5111107640 1 -- 172.21.15.12:0/829581508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc0317a0 con 0x7f510c148330 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f5111107640 1 -- 172.21.15.12:0/829581508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc031b70 con 0x7f510c148330 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 -- 172.21.15.12:0/829581508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 msgr2=0x7f510c06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 --2- 172.21.15.12:0/829581508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c06bba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009d90 tx=0x7f50fc02a610 comp rx=0 tx=0).stop 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 -- 172.21.15.12:0/829581508 shutdown_connections 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 --2- 172.21.15.12:0/829581508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c06bba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 -- 172.21.15.12:0/829581508 >> 172.21.15.12:0/829581508 conn(0x7f510c062a80 msgr2=0x7f510c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 -- 172.21.15.12:0/829581508 shutdown_connections 2024-09-10T09:23:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.120+0000 7f511436d640 1 -- 172.21.15.12:0/829581508 wait complete. 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.121+0000 7f511436d640 1 Processor -- start 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.121+0000 7f511436d640 1 -- start start 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f511436d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f510c06c0e0 0x7f510c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f511436d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f511436d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510c15f5d0 0x7f510c1f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f511436d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f510c15fe50 con 0x7f510c148330 2024-09-10T09:23:39.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f511436d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f510c0b5820 con 0x7f510c15f5d0 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f511436d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f510c15ffd0 con 0x7f510c06c0e0 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f5111908640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f5111908640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c0cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44862/0 (socket says 172.21.15.12:44862) 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.122+0000 7f5111908640 1 -- 172.21.15.12:0/1849745624 learned_addr learned my addr 172.21.15.12:0/1849745624 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f511290a640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510c15f5d0 0x7f510c1f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5112109640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f510c06c0e0 0x7f510c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5111908640 1 -- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f510c06c0e0 msgr2=0x7f510c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5111908640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f510c06c0e0 0x7f510c15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5111908640 1 -- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510c15f5d0 msgr2=0x7f510c1f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:39.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5111908640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510c15f5d0 0x7f510c1f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5111908640 1 -- 172.21.15.12:0/1849745624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c15b400 con 0x7f510c148330 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f5111908640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c0cad20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f510000c430 tx=0x7f510000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100011790 con 0x7f510c148330 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100017070 con 0x7f510c148330 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c15b6e0 con 0x7f510c148330 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100011bb0 con 0x7f510c148330 2024-09-10T09:23:39.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.123+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c15bca0 con 0x7f510c148330 2024-09-10T09:23:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.124+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c06bba0 con 0x7f510c148330 2024-09-10T09:23:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.124+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f510001c460 con 0x7f510c148330 2024-09-10T09:23:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.125+0000 7f510affd640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f50f806bfe0 0x7f50f806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.125+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f510008ace0 con 0x7f510c148330 2024-09-10T09:23:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.125+0000 7f5112109640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f50f806bfe0 0x7f50f806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.126+0000 7f5112109640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f50f806bfe0 0x7f50f806e4a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f50fc034000 tx=0x7f50fc02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.129+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51000597a0 con 0x7f510c148330 2024-09-10T09:23:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.359+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f510c0b3cc0 con 0x7f510c148330 2024-09-10T09:23:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.364+0000 7f510affd640 1 -- 172.21.15.12:0/1849745624 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) ==== 81+0+471205 (secure 0 0 0) 0x7f51000590a0 con 0x7f510c148330 2024-09-10T09:23:39.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:39.370 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:39.370 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 7, 2024-09-10T09:23:39.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.370 INFO:teuthology.orchestra.run.smithi012.stdout: "active_gid": 4102, 2024-09-10T09:23:39.370 INFO:teuthology.orchestra.run.smithi012.stdout: "active_name": "x", 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addrs": { 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:6832", 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3276402792 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:6833", 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3276402792 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:39.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addr": "172.21.15.100:6833/3276402792", 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "active_change": "2024-09-10T09:22:19.208692+0000", 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "available": true, 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "standbys": [ 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 4110, 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "y", 2024-09-10T09:23:39.372 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.373 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.375 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-10T09:23:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-10T09:23:39.381 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-10T09:23:39.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-10T09:23:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.384 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T09:23:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-10T09:23:39.388 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.390 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-10T09:23:39.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T09:23:39.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-10T09:23:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.399 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.400 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.401 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-10T09:23:39.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-10T09:23:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T09:23:39.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T09:23:39.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.409 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-10T09:23:39.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.412 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-10T09:23:39.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-10T09:23:39.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-10T09:23:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.418 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.421 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-10T09:23:39.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-10T09:23:39.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-10T09:23:39.429 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-10T09:23:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.434 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.435 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.441 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.443 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.444 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.446 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.447 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.449 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.451 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.452 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.456 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T09:23:39.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.458 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.458 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T09:23:39.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T09:23:39.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.459 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.463 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-10T09:23:39.464 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-10T09:23:39.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.466 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.467 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.468 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.469 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-10T09:23:39.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-10T09:23:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-10T09:23:39.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.472 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.473 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.478 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.481 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.482 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.483 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.484 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-10T09:23:39.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T09:23:39.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.493 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.494 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.495 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T09:23:39.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.500 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.501 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T09:23:39.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.504 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.507 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.508 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.509 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T09:23:39.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T09:23:39.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T09:23:39.513 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.514 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.516 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.517 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.518 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T09:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T09:23:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T09:23:39.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T09:23:39.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T09:23:39.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T09:23:39.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T09:23:39.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T09:23:39.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.529 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.532 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-10T09:23:39.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-10T09:23:39.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.540 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.542 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-10T09:23:39.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-10T09:23:39.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-10T09:23:39.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.551 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-10T09:23:39.554 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.555 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.556 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.565 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.566 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.570 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.571 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.574 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-10T09:23:39.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.576 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.577 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.580 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.582 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.584 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.592 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.593 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.599 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.600 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.601 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.603 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.606 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.608 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.609 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.613 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.614 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.616 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.619 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.620 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.621 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.622 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.623 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.624 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.625 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.626 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.627 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-10T09:23:39.630 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.630 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.630 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.630 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-10T09:23:39.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-10T09:23:39.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.633 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.635 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-10T09:23:39.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.638 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.639 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.642 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.643 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.644 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.645 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.647 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.650 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.651 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.652 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.653 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-10T09:23:39.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-10T09:23:39.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.660 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.661 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.662 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-10T09:23:39.664 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.667 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T09:23:39.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.669 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.673 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.680 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.681 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.685 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.688 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-10T09:23:39.690 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.691 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.699 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.701 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.702 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.704 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.708 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.709 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.711 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.712 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.713 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.715 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.716 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.719 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.720 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.724 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.725 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.730 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.731 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.732 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.733 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.734 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.735 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.736 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.737 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.738 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.739 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.741 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.742 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.744 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.745 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.746 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.749 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.750 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.751 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.752 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.753 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.754 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.755 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.757 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.758 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.761 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.762 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T09:23:39.763 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.764 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-10T09:23:39.765 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.766 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.767 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.769 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.770 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.771 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.772 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.773 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.774 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.775 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.777 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.778 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.779 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.780 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.781 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-10T09:23:39.782 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.783 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.784 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.785 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.786 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.788 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.791 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.793 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.794 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.795 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.798 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.799 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "modules": [ 2024-09-10T09:23:39.803 INFO:teuthology.orchestra.run.smithi012.stdout: "iostat", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "nfs", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "restful" 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.804 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.806 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.807 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.808 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-10T09:23:39.811 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.812 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.814 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.816 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.818 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.825 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.828 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.829 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-10T09:23:39.833 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.834 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.835 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.836 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.837 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.838 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-10T09:23:39.839 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.839 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.839 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.842 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T09:23:39.845 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-10T09:23:39.846 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.847 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.848 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.849 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T09:23:39.850 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.852 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.853 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.855 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.856 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.858 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.860 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.861 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.863 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.865 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T09:23:39.866 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T09:23:39.867 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T09:23:39.868 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T09:23:39.869 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-10T09:23:39.870 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T09:23:39.871 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T09:23:39.873 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-10T09:23:39.874 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T09:23:39.875 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.876 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.877 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.878 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.879 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.880 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.881 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.886 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.887 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-10T09:23:39.888 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.889 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.891 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.893 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.894 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.895 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.896 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.897 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T09:23:39.898 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T09:23:39.899 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T09:23:39.900 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T09:23:39.901 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.902 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.905 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.906 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.908 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.909 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-10T09:23:39.910 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.913 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.914 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.917 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.922 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.924 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.929 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.930 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T09:23:39.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T09:23:39.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T09:23:39.933 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T09:23:39.934 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.935 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.936 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.937 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.938 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T09:23:39.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T09:23:39.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T09:23:39.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T09:23:39.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T09:23:39.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T09:23:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T09:23:39.945 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T09:23:39.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T09:23:39.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T09:23:39.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T09:23:39.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T09:23:39.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T09:23:39.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T09:23:39.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-10T09:23:39.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-10T09:23:39.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.957 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-10T09:23:39.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-10T09:23:39.966 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-10T09:23:39.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-10T09:23:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.974 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:39.989 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:39.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-10T09:23:39.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-10T09:23:39.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-10T09:23:39.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-10T09:23:39.994 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.997 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:39.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:39.999 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.011 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.012 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.013 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.016 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.017 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.022 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-10T09:23:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T09:23:40.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-10T09:23:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T09:23:40.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.035 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-10T09:23:40.038 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.038 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.038 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.038 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.042 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.045 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-10T09:23:40.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.054 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-10T09:23:40.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.062 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.063 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.064 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.067 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.068 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.075 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-10T09:23:40.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-10T09:23:40.077 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.081 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-10T09:23:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-10T09:23:40.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.085 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.087 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.088 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.092 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.094 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T09:23:40.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T09:23:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-10T09:23:40.099 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-10T09:23:40.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.101 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.102 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.104 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.109 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.110 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.120 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.122 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.134 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-10T09:23:40.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.138 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.141 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-10T09:23:40.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-10T09:23:40.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-10T09:23:40.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.151 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.152 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.158 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.159 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.161 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.162 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.165 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:40.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.170 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.172 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.174 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.176 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.199 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.200 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.201 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.202 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.207 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.208 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.209 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.211 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.214 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-10T09:23:40.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "services": {}, 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "always_on_modules": { 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "octopus": [ 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-10T09:23:40.222 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "pacific": [ 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-10T09:23:40.223 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "quincy": [ 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: "reef": [ 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "squid": [ 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-10T09:23:40.225 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "last_failure_osd_epoch": 0, 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "active_clients": [ 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-10T09:23:40.226 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2824567996 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "libcephsqlite", 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 289943908 2024-09-10T09:23:40.227 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1852658990 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3493327657 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.229 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 4187679017 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2445642926 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-10T09:23:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.100:0", 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 4071004036 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-10T09:23:40.231 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f50f806bfe0 msgr2=0x7f50f806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f50f806bfe0 0x7f50f806e4a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f50fc034000 tx=0x7f50fc02f000 comp rx=0 tx=0).stop 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 msgr2=0x7f510c0cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c0cad20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f510000c430 tx=0x7f510000c8f0 comp rx=0 tx=0).stop 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 shutdown_connections 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f50f806bfe0 0x7f50f806e4a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f510c15f5d0 0x7f510c1f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c148330 0x7f510c0cad20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 --2- 172.21.15.12:0/1849745624 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f510c06c0e0 0x7f510c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 >> 172.21.15.12:0/1849745624 conn(0x7f510c062a80 msgr2=0x7f510c15c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 shutdown_connections 2024-09-10T09:23:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:39.368+0000 7f511436d640 1 -- 172.21.15.12:0/1849745624 wait complete. 2024-09-10T09:23:40.292 DEBUG:tasks.check_counter:Getting stats from x 2024-09-10T09:23:40.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.x.asok perf dump 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 210, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 67, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2680608, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 8371, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 74, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 16, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.052803602, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.001656695, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.052157748, 2024-09-10T09:23:40.406 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 54, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.209249575, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003874992 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2680608, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 8240 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.407 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 625, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 438, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2497232, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 2795888, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 92, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 19, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.094104759, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.027100753, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.081846697, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000060609, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 423, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.025848540, 2024-09-10T09:23:40.408 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000061107 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 278, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000036081, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000129 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2497232, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 2795888 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 482, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 329, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3062832, 2024-09-10T09:23:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 2963488, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 105, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 24, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.098032457, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.011688945, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.105823667, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.002642383, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 317, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.229323351, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000723417 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 206, 2024-09-10T09:23:40.410 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000027272, 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000132 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3062832, 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 2963488 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-10T09:23:40.411 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "client": { 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": { 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "lat": { 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "wrlat": { 2024-09-10T09:23:40.412 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "rdlat": { 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "fsync": { 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.413 INFO:teuthology.orchestra.run.smithi100.stdout: "mdavg": 0.000000000, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsqsum": 0, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "mdops": 0, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "readavg": 0.000000000, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "readsqsum": 0, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 0, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "writeavg": 0.000000000, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "writesqsum": 0, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 0 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "client-0x55c578c37360": { 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": { 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 57, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.064098774, 2024-09-10T09:23:40.414 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001124539 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "lat": { 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 57, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.064098774, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001124539 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "wrlat": { 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "rdlat": { 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.415 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "fsync": { 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "mdavg": 0.001124525, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsqsum": 91959427427637, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "mdops": 57, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "readavg": 0.000000000, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "readsqsum": 0, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 0, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "writeavg": 0.000000000, 2024-09-10T09:23:40.416 INFO:teuthology.orchestra.run.smithi100.stdout: "writesqsum": 0, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 0 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "client-0x55c578c37900": { 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": { 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 68, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.085334894, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001254924 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "lat": { 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 68, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.085334894, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001254924 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.417 INFO:teuthology.orchestra.run.smithi100.stdout: "wrlat": { 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 18, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000369917, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000020550 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "rdlat": { 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 18, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000343700, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000019094 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "fsync": { 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014852357, 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004950785 2024-09-10T09:23:40.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "mdavg": 0.001254907, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsqsum": 127560778045521, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "mdops": 68, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "readavg": 0.000019090, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "readsqsum": 909706705, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 18, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "writeavg": 0.000020547, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "writesqsum": 1752125680, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 18 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "client-0x55c57904a780": { 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": { 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 20, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.325633670, 2024-09-10T09:23:40.419 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.016281683 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "lat": { 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 20, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.325633670, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.016281683 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "wrlat": { 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "rdlat": { 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.420 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "fsync": { 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "mdavg": 0.016281679, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsqsum": 92276226889282768, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "mdops": 20, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "readavg": 0.000000000, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "readsqsum": 0, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 0, 2024-09-10T09:23:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: "writeavg": 0.000000000, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "writesqsum": 0, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "rdops": 0 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-Mgr": { 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.031514084, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.015757042 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MgrStandby": { 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.422 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-balancer": { 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-cmd_finisher": { 2024-09-10T09:23:40.423 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 13, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000629729, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000048440 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-crash": { 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-devicehealth": { 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-iostat": { 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-nfs": { 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-orchestrator": { 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.426 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-pg_autoscaler": { 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-progress": { 2024-09-10T09:23:40.427 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-rbd_support": { 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.428 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-restful": { 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 13, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002577037, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000198233 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-status": { 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-telemetry": { 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-volumes": { 2024-09-10T09:23:40.430 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 9, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.146244454, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.016249383 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "libcephsqlite_striper": { 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "update_metadata": 8, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "update_allocated": 2, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "update_size": 6, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "update_version": 8, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "shrink": 0, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "shrink_bytes": 0, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "lock": 11, 2024-09-10T09:23:40.431 INFO:teuthology.orchestra.run.smithi100.stdout: "unlock": 11 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "libcephsqlite_vfs": { 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "op_open": { 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.147996104, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.073998052 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "op_delete": { 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "op_access": { 2024-09-10T09:23:40.432 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "op_fullpathname": { 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "op_currenttime": { 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.433 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_close": { 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_read": { 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 20, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.004999869, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000249993 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_write": { 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 85, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.007999787, 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000094115 2024-09-10T09:23:40.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_truncate": { 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_sync": { 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 24, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.103997264, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004333219 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_filesize": { 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 20, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_lock": { 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 27, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.021999419, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000814793 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_unlock": { 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 19, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.018999502, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000999973 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_checkreservedlock": { 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 9, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.436 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_filecontrol": { 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 26, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_sectorsize": { 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "opf_devicecharacteristics": { 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 30, 2024-09-10T09:23:40.437 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T09:23:40.438 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-10T09:23:40.439 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 1665385, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 324, 2024-09-10T09:23:40.440 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 1496, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 17, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 48184, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 822, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 12880, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 308, 2024-09-10T09:23:40.441 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_hit": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_miss": 0 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "objectcacher-libcephfs": { 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_hit": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_miss": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_hit": 0, 2024-09-10T09:23:40.442 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_miss": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "data_read": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "data_written": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "data_flushed": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "data_overwritten_while_flushing": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "write_ops_blocked": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "write_bytes_blocked": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "write_time_blocked": 0.000000000 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "objectcacher-libcephfs-0x55c578c377c0": { 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_hit": 9, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_miss": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_hit": 1230, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_miss": 0, 2024-09-10T09:23:40.443 INFO:teuthology.orchestra.run.smithi100.stdout: "data_read": 1230, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "data_written": 410, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "data_flushed": 410, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "data_overwritten_while_flushing": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "write_ops_blocked": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "write_bytes_blocked": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "write_time_blocked": 0.000000000 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "objectcacher-libcephfs-0x55c578c37d60": { 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_hit": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_miss": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_hit": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_miss": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "data_read": 0, 2024-09-10T09:23:40.444 INFO:teuthology.orchestra.run.smithi100.stdout: "data_written": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "data_flushed": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "data_overwritten_while_flushing": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "write_ops_blocked": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "write_bytes_blocked": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "write_time_blocked": 0.000000000 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "objectcacher-libcephfs-0x55c57904a280": { 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_hit": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_ops_miss": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_hit": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "cache_bytes_miss": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "data_read": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "data_written": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "data_flushed": 0, 2024-09-10T09:23:40.445 INFO:teuthology.orchestra.run.smithi100.stdout: "data_overwritten_while_flushing": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "write_ops_blocked": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "write_bytes_blocked": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "write_time_blocked": 0.000000000 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.446 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.447 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.448 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.449 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.450 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.450 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.450 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.450 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.450 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.451 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.451 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 8, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 35, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 34, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 8, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 8, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c578038640": { 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 163, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 2434716, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 163, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 163, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.652982811, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004006029 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.453 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 163, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 307 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 163, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 46, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 117, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 2, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 20, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 85, 2024-09-10T09:23:40.454 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 104, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 52, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 22, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 22, 2024-09-10T09:23:40.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.456 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 16, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 6, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 1, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 1, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.457 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c5780388c0": { 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.458 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.461 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 0, 2024-09-10T09:23:40.462 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c578038b40": { 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 0, 2024-09-10T09:23:40.463 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.464 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.465 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.466 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.467 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c5780395e0": { 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 1, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 39, 2024-09-10T09:23:40.468 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 1, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000999974, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000999974 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 1, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 1, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T09:23:40.469 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.470 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 1, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.471 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.472 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 1, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 1, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c578c37860": { 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.473 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 3, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 410, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 3, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011999683, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003999894 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 3 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.474 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 3, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 3, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 3, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.475 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.477 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 2, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 2, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.478 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c578c37cc0": { 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.479 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.480 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.481 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.482 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter-0x55c57904a320": { 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T09:23:40.485 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T09:23:40.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T09:23:40.487 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T09:23:40.488 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_client_bytes": { 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 134217728, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 54, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 171164, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 54, 2024-09-10T09:23:40.489 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 72, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 171164, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_client_messages": { 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 512, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.490 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 54, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 54, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 54, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 54, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 54, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_mds_bytes": { 2024-09-10T09:23:40.491 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 134217728, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 69, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 822188, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 69, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 69, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 822188, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.492 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_mds_messsages": { 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 128, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 69, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 69, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 69, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 69, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 69, 2024-09-10T09:23:40.493 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_mon_bytes": { 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 134217728, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 54, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 430007, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 54, 2024-09-10T09:23:40.494 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 54, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 430007, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_mon_messsages": { 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 128, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.495 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 54, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 54, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 54, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 54, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 54, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_osd_bytes": { 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 536870912, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 277, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 3740071, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 277, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 277, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 3740071, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.497 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-mgr_osd_messsages": { 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 8192, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 277, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 277, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 277, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 277, 2024-09-10T09:23:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 277, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-client": { 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 172, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 66997, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.499 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 172, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 172, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 66997, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-client-0x55c578c37f40": { 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.500 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 88, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 46633, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 88, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 88, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 46633, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.501 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-client-0x55c57904a0a0": { 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 38, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 21336, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 38, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 38, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 21336, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.502 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 324, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 842704, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 324, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 324, 2024-09-10T09:23:40.503 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 842704, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55c57333d400": { 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 454, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 5163430, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.504 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 454, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 454, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 5163430, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.505 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 176, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 543691, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 176, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 176, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 543691, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55c57333d680": { 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 12, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 500443, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 12, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 12, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 500443, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.507 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55c578038aa0": { 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 11, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 500419, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 11, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.508 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 11, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 500419, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55c578039ea0": { 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 10, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 368214, 2024-09-10T09:23:40.509 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 10, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 10, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 368214, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.510 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c578038140": { 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 1, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 1, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.512 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c578038500": { 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 163, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 2433027, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 163, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.513 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 163, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2433027, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c578038a00": { 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.514 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c578038c80": { 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.516 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c578c37680": { 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 3, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 410, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 3, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 410, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.517 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c578c37ea0": { 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.518 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes-0x55c57904a140": { 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.519 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.520 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.521 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c5780385a0": { 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 163, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 163, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 163, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 163, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 163, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.522 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c578038960": { 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.523 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c578038be0": { 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.524 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c578039220": { 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.525 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 1, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 1, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c578c37720": { 2024-09-10T09:23:40.526 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 3, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 3, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 3, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 3, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c578c37e00": { 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.528 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops-0x55c57904a1e0": { 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T09:23:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T09:23:40.530 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T09:23:40.532 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.complete_latency.avgcount=9 2024-09-10T09:23:40.532 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.queue_len=0 2024-09-10T09:23:40.532 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T09:23:40.574 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T09:23:40.574 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:40.574 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:40.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=100 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T09:23:40.595 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-10T09:23:40.595 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:40.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=100 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T09:23:40.654 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:40.655 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:40.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2441 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T09:23:40.673 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T09:23:40.673 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:23:40.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2441 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T09:23:40.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:40.730 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:23:40.750 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T09:23:40.750 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T09:23:40.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:40.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T09:23:40.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:40.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T09:23:40.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:40.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-10T09:23:40.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:40.986 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-10T09:23:41.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-10T09:23:41.073 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-10T09:23:41.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:23:41.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.076 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:23:41.095 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T09:23:41.095 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T09:23:41.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T09:23:41.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.166 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T09:23:41.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-10T09:23:41.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.343 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-10T09:23:41.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:23:41.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-10T09:23:41.429 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-09-10T09:23:41.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:23:41.430 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T09:23:41.441 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T09:23:41.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.551+0000 7ff5107c4640 1 Processor -- start 2024-09-10T09:23:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.551+0000 7ff5107c4640 1 -- start start 2024-09-10T09:23:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.552+0000 7ff5107c4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5080d02a0 0x7ff5080d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.552+0000 7ff5107c4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff50815ceb0 0x7ff5081594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.552+0000 7ff5107c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5080d0bc0 con 0x7ff50815ca40 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.552+0000 7ff5107c4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff50815d390 con 0x7ff5080d02a0 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.552+0000 7ff5107c4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff50815d670 con 0x7ff50815ceb0 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5080d02a0 0x7ff5080d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5080d02a0 0x7ff5080d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44866/0 (socket says 172.21.15.12:44866) 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 -- 172.21.15.12:0/432483409 learned_addr learned my addr 172.21.15.12:0/432483409 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50ed61640 1 --2- 172.21.15.12:0/432483409 >> v2:172.21.15.100:3300/0 conn(0x7ff50815ceb0 0x7ff5081594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 -- 172.21.15.12:0/432483409 >> v2:172.21.15.100:3300/0 conn(0x7ff50815ceb0 msgr2=0x7ff5081594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 --2- 172.21.15.12:0/432483409 >> v2:172.21.15.100:3300/0 conn(0x7ff50815ceb0 0x7ff5081594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 -- 172.21.15.12:0/432483409 >> v1:172.21.15.100:6789/0 conn(0x7ff50815ca40 legacy=0x7ff50815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.553+0000 7ff50e560640 1 -- 172.21.15.12:0/432483409 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50815d950 con 0x7ff5080d02a0 2024-09-10T09:23:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff50e560640 1 --2- 172.21.15.12:0/432483409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5080d02a0 0x7ff5080d0680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff5080b52b0 tx=0x7ff50402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfea58c1052cd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff50d55e640 1 -- 172.21.15.12:0/432483409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50400b2d0 con 0x7ff5080d02a0 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff50d55e640 1 -- 172.21.15.12:0/432483409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50400b470 con 0x7ff5080d02a0 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff50d55e640 1 -- 172.21.15.12:0/432483409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504009820 con 0x7ff5080d02a0 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 -- 172.21.15.12:0/432483409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5080d02a0 msgr2=0x7ff5080d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 --2- 172.21.15.12:0/432483409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5080d02a0 0x7ff5080d0680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff5080b52b0 tx=0x7ff50402c8b0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 -- 172.21.15.12:0/432483409 shutdown_connections 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 --2- 172.21.15.12:0/432483409 >> v2:172.21.15.100:3300/0 conn(0x7ff50815ceb0 0x7ff5081594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 --2- 172.21.15.12:0/432483409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5080d02a0 0x7ff5080d0680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 -- 172.21.15.12:0/432483409 >> 172.21.15.12:0/432483409 conn(0x7ff508062cc0 msgr2=0x7ff50806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 -- 172.21.15.12:0/432483409 shutdown_connections 2024-09-10T09:23:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.554+0000 7ff5107c4640 1 -- 172.21.15.12:0/432483409 wait complete. 2024-09-10T09:23:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 Processor -- start 2024-09-10T09:23:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 -- start start 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5080d02a0 0x7ff50814c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 0x7ff508071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ceb0 0x7ff508072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff50815eb40 con 0x7ff50815ca40 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff50815df10 con 0x7ff50815ceb0 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.556+0000 7ff5107c4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff508155b90 con 0x7ff5080d02a0 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50dd5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 0x7ff508071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50e560640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5080d02a0 0x7ff50814c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50dd5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 0x7ff508071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44868/0 (socket says 172.21.15.12:44868) 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50dd5f640 1 -- 172.21.15.12:0/3819476073 learned_addr learned my addr 172.21.15.12:0/3819476073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ceb0 0x7ff508072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 -- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5080d02a0 msgr2=0x7ff50814c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5080d02a0 0x7ff50814c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 -- 172.21.15.12:0/3819476073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 msgr2=0x7ff508071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 0x7ff508071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 -- 172.21.15.12:0/3819476073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff508158000 con 0x7ff50815ceb0 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50dd5f640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 0x7ff508071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff50ed61640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ceb0 0x7ff508072c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff50000e7c0 tx=0x7ff50000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500017070 con 0x7ff50815ceb0 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50000c730 con 0x7ff50815ceb0 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff508157a40 con 0x7ff50815ceb0 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000cb60 con 0x7ff50815ceb0 2024-09-10T09:23:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.557+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081e3f60 con 0x7ff50815ceb0 2024-09-10T09:23:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.558+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5080b4790 con 0x7ff50815ceb0 2024-09-10T09:23:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.559+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ff50001a070 con 0x7ff50815ceb0 2024-09-10T09:23:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.559+0000 7ff4feffd640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff4ec06bfe0 0x7ff4ec06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.559+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff50008ac60 con 0x7ff50815ceb0 2024-09-10T09:23:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.560+0000 7ff50e560640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff4ec06bfe0 0x7ff4ec06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.560+0000 7ff50e560640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff4ec06bfe0 0x7ff4ec06e4a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff504036000 tx=0x7ff50400b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.564+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff500058fd0 con 0x7ff50815ceb0 2024-09-10T09:23:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.737+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff50806c7e0 con 0x7ff4ec06bfe0 2024-09-10T09:23:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.738+0000 7ff4feffd640 1 -- 172.21.15.12:0/3819476073 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13490 (secure 0 0 0) 0x7ff50806c7e0 con 0x7ff4ec06bfe0 2024-09-10T09:23:41.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff4ec06bfe0 msgr2=0x7ff4ec06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff4ec06bfe0 0x7ff4ec06e4a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff504036000 tx=0x7ff50400b000 comp rx=0 tx=0).stop 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ceb0 msgr2=0x7ff508072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ceb0 0x7ff508072c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff50000e7c0 tx=0x7ff50000ec80 comp rx=0 tx=0).stop 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 shutdown_connections 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ff4ec06bfe0 0x7ff4ec06e4a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff50815ceb0 0x7ff508072c30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff50815ca40 0x7ff508071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 --2- 172.21.15.12:0/3819476073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5080d02a0 0x7ff50814c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 >> 172.21.15.12:0/3819476073 conn(0x7ff508062cc0 msgr2=0x7ff50806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 shutdown_connections 2024-09-10T09:23:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.741+0000 7ff5107c4640 1 -- 172.21.15.12:0/3819476073 wait complete. 2024-09-10T09:23:41.753 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-10T09:23:41.235674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220408,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754312,"statfs":{"total":773094113280,"available":772868415488,"internally_reserved":0,"allocated":4268032,"data_stored":2375656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-126192,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-93,"num_write_kb":-161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.900403"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T09:23:36.707391+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:36.707391+0000","last_peered":"2024-09-10T09:23:36.707391+0000","last_clean":"2024-09-10T09:23:36.707391+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:36.707391+0000","last_undegraded":"2024-09-10T09:23:36.707391+0000","last_fullsized":"2024-09-10T09:23:36.707391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":978944,"data_stored":739733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":739733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:41.754 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:41.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.855+0000 7f6ea14f1640 1 Processor -- start 2024-09-10T09:23:41.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.855+0000 7f6ea14f1640 1 -- start start 2024-09-10T09:23:41.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6ea14f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c15e3f0 0x7f6e9c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6ea14f1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6e9c162110 0x7f6e9c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6ea14f1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 0x7f6e9c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6ea14f1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c0b30d0 con 0x7f6e9c06c0e0 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6ea14f1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c06c520 con 0x7f6e9c162110 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6ea14f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c15fa90 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6e9b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 0x7f6e9c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6e9b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 0x7f6e9c0ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44874/0 (socket says 172.21.15.12:44874) 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6e9b7fe640 1 -- 172.21.15.12:0/3370628012 learned_addr learned my addr 172.21.15.12:0/3370628012 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6e9affd640 1 --2- 172.21.15.12:0/3370628012 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c15e3f0 0x7f6e9c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.856+0000 7f6e93fff640 1 --2- 172.21.15.12:0/3370628012 >> v2:172.21.15.100:3300/0 conn(0x7f6e9c162110 0x7f6e9c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9affd640 1 -- 172.21.15.12:0/3370628012 >> v2:172.21.15.100:3300/0 conn(0x7f6e9c162110 msgr2=0x7f6e9c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9affd640 1 --2- 172.21.15.12:0/3370628012 >> v2:172.21.15.100:3300/0 conn(0x7f6e9c162110 0x7f6e9c06bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9affd640 1 -- 172.21.15.12:0/3370628012 >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 msgr2=0x7f6e9c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:41.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9affd640 1 --2- 172.21.15.12:0/3370628012 >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 0x7f6e9c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9affd640 1 -- 172.21.15.12:0/3370628012 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c162660 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9b7fe640 1 --2- 172.21.15.12:0/3370628012 >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 0x7f6e9c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.857+0000 7f6e9affd640 1 --2- 172.21.15.12:0/3370628012 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c15e3f0 0x7f6e9c15f550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c073560 tx=0x7f6e8c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c139ee437faec0b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6e9a7fc640 1 -- 172.21.15.12:0/3370628012 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c037070 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6e9a7fc640 1 -- 172.21.15.12:0/3370628012 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c02ae50 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6e9a7fc640 1 -- 172.21.15.12:0/3370628012 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c032660 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 -- 172.21.15.12:0/3370628012 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c15e3f0 msgr2=0x7f6e9c15f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/3370628012 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c15e3f0 0x7f6e9c15f550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c073560 tx=0x7f6e8c02a100 comp rx=0 tx=0).stop 2024-09-10T09:23:41.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 -- 172.21.15.12:0/3370628012 shutdown_connections 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/3370628012 >> v2:172.21.15.12:3300/0 conn(0x7f6e9c06c0e0 0x7f6e9c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/3370628012 >> v2:172.21.15.100:3300/0 conn(0x7f6e9c162110 0x7f6e9c06bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/3370628012 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c15e3f0 0x7f6e9c15f550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 -- 172.21.15.12:0/3370628012 >> 172.21.15.12:0/3370628012 conn(0x7f6e9c06ce90 msgr2=0x7f6e9c06d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 -- 172.21.15.12:0/3370628012 shutdown_connections 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.858+0000 7f6ea14f1640 1 -- 172.21.15.12:0/3370628012 wait complete. 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 Processor -- start 2024-09-10T09:23:41.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 -- start start 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9c06c0e0 0x7f6e9c15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 0x7f6e9c14bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c162110 0x7f6e9c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c162f00 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c162c20 con 0x7f6e9c06c0e0 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6ea14f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c0b0380 con 0x7f6e9c162110 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6e93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 0x7f6e9c14bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6e93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 0x7f6e9c14bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44878/0 (socket says 172.21.15.12:44878) 2024-09-10T09:23:41.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.860+0000 7f6e93fff640 1 -- 172.21.15.12:0/1444793705 learned_addr learned my addr 172.21.15.12:0/1444793705 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e9affd640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9c06c0e0 0x7f6e9c15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e9b7fe640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c162110 0x7f6e9c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e93fff640 1 -- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c162110 msgr2=0x7f6e9c0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e93fff640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c162110 0x7f6e9c0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e93fff640 1 -- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9c06c0e0 msgr2=0x7f6e9c15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e93fff640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9c06c0e0 0x7f6e9c15c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e93fff640 1 -- 172.21.15.12:0/1444793705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c15b4a0 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e93fff640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 0x7f6e9c14bda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400e870 tx=0x7f6e8400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84017070 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8400c940 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c15b780 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400cd30 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.861+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c15bd40 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.862+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9c15c180 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.863+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6e8401a070 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.863+0000 7f6e937fe640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6e7c06bfe0 0x7f6e7c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:41.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.863+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f6e8408ae80 con 0x7f6e9c15e3f0 2024-09-10T09:23:41.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.863+0000 7f6e9affd640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6e7c06bfe0 0x7f6e7c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:41.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.864+0000 7f6e9affd640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6e7c06bfe0 0x7f6e7c06e4a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c073560 tx=0x7f6e8c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:41.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:41.868+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e84059320 con 0x7f6e9c15e3f0 2024-09-10T09:23:42.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.041+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e9c15e860 con 0x7f6e7c06bfe0 2024-09-10T09:23:42.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.043+0000 7f6e937fe640 1 -- 172.21.15.12:0/1444793705 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13490 (secure 0 0 0) 0x7f6e9c15e860 con 0x7f6e7c06bfe0 2024-09-10T09:23:42.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:42.043 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6e7c06bfe0 msgr2=0x7f6e7c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6e7c06bfe0 0x7f6e7c06e4a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c073560 tx=0x7f6e8c02e000 comp rx=0 tx=0).stop 2024-09-10T09:23:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 msgr2=0x7f6e9c14bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 0x7f6e9c14bda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400e870 tx=0x7f6e8400ed30 comp rx=0 tx=0).stop 2024-09-10T09:23:42.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 shutdown_connections 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f6e7c06bfe0 0x7f6e7c06e4a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6e9c162110 0x7f6e9c0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e9c15e3f0 0x7f6e9c14bda0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 --2- 172.21.15.12:0/1444793705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9c06c0e0 0x7f6e9c15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 >> 172.21.15.12:0/1444793705 conn(0x7f6e9c06ce90 msgr2=0x7f6e9c1590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 shutdown_connections 2024-09-10T09:23:42.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.044+0000 7f6ea14f1640 1 -- 172.21.15.12:0/1444793705 wait complete. 2024-09-10T09:23:42.056 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-10T09:23:41.235674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220408,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754312,"statfs":{"total":773094113280,"available":772868415488,"internally_reserved":0,"allocated":4268032,"data_stored":2375656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-126192,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-93,"num_write_kb":-161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.900403"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T09:23:36.707391+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:36.707391+0000","last_peered":"2024-09-10T09:23:36.707391+0000","last_clean":"2024-09-10T09:23:36.707391+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:36.707391+0000","last_undegraded":"2024-09-10T09:23:36.707391+0000","last_fullsized":"2024-09-10T09:23:36.707391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":978944,"data_stored":739733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":739733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:42.056 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T09:23:42.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.158+0000 7f1038f11640 1 Processor -- start 2024-09-10T09:23:42.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.158+0000 7f1038f11640 1 -- start start 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f1038f11640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f103415c180 0x7f10340cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f1038f11640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10340ce740 con 0x7f10340ce230 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f1038f11640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1034072640 con 0x7f1034073120 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f1038f11640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1034072920 con 0x7f103415c180 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f103259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f103415c180 0x7f10340cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f1031d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f10340ce230 0x7f10340cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53608/0 (socket says 172.21.15.12:53608) 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f1031d9b640 1 -- 172.21.15.12:0/1019322029 learned_addr learned my addr 172.21.15.12:0/1019322029 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f103259c640 1 -- 172.21.15.12:0/1019322029 >> v1:172.21.15.100:6789/0 conn(0x7f1034073120 legacy=0x7f103406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f103259c640 1 -- 172.21.15.12:0/1019322029 >> v1:172.21.15.12:6789/0 conn(0x7f10340ce230 legacy=0x7f10340cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f103159a640 1 -- 172.21.15.12:0/1019322029 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276692771 0 0) 0x7f10340ce740 con 0x7f10340ce230 2024-09-10T09:23:42.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.159+0000 7f103259c640 1 -- 172.21.15.12:0/1019322029 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1034072c00 con 0x7f103415c180 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.160+0000 7f103259c640 1 --2- 172.21.15.12:0/1019322029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f103415c180 0x7f10340cdcf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f10240097a0 tx=0x7f102402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825499faf74244c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.160+0000 7f103159a640 1 -- 172.21.15.12:0/1019322029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024037070 con 0x7f103415c180 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.160+0000 7f103159a640 1 -- 172.21.15.12:0/1019322029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102402ae50 con 0x7f103415c180 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.160+0000 7f103159a640 1 -- 172.21.15.12:0/1019322029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024032660 con 0x7f103415c180 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 -- 172.21.15.12:0/1019322029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f103415c180 msgr2=0x7f10340cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 --2- 172.21.15.12:0/1019322029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f103415c180 0x7f10340cdcf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f10240097a0 tx=0x7f102402a140 comp rx=0 tx=0).stop 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 -- 172.21.15.12:0/1019322029 shutdown_connections 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 --2- 172.21.15.12:0/1019322029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f103415c180 0x7f10340cdcf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 -- 172.21.15.12:0/1019322029 >> 172.21.15.12:0/1019322029 conn(0x7f1034062cc0 msgr2=0x7f103406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 -- 172.21.15.12:0/1019322029 shutdown_connections 2024-09-10T09:23:42.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.161+0000 7f1038f11640 1 -- 172.21.15.12:0/1019322029 wait complete. 2024-09-10T09:23:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.162+0000 7f1038f11640 1 Processor -- start 2024-09-10T09:23:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.162+0000 7f1038f11640 1 -- start start 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1038f11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 0x7f1034154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1038f11640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f10340ce230 0x7f10340ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1038f11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f103415c180 0x7f10340ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1038f11640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10340cf780 con 0x7f1034073120 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1038f11640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10340722f0 con 0x7f103415c180 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1038f11640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f103415c560 con 0x7f10340ce230 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 0x7f1034154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 0x7f1034154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44892/0 (socket says 172.21.15.12:44892) 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 -- 172.21.15.12:0/1200845083 learned_addr learned my addr 172.21.15.12:0/1200845083 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1032d9d640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f103415c180 0x7f10340ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1031d9b640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f10340ce230 0x7f10340ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 -- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f10340ce230 msgr2=0x7f10340ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f10340ce230 0x7f10340ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 -- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f103415c180 msgr2=0x7f10340ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f103415c180 0x7f10340ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 -- 172.21.15.12:0/1200845083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10340aa990 con 0x7f1034073120 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f1032d9d640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f103415c180 0x7f10340ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.163+0000 7f103259c640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 0x7f1034154d30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f10240097a0 tx=0x7f10240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.164+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024042070 con 0x7f1034073120 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.164+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102403e670 con 0x7f1034073120 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.164+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024037040 con 0x7f1034073120 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.164+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10340ad5e0 con 0x7f1034073120 2024-09-10T09:23:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.164+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10340adba0 con 0x7f1034073120 2024-09-10T09:23:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.165+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103415b9a0 con 0x7f1034073120 2024-09-10T09:23:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.165+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1024045070 con 0x7f1034073120 2024-09-10T09:23:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.166+0000 7f1022ffd640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f101406c010 0x7f101406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.166+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f10240ab590 con 0x7f1034073120 2024-09-10T09:23:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.166+0000 7f1031d9b640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f101406c010 0x7f101406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.166+0000 7f1031d9b640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f101406c010 0x7f101406e4d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f10341f5660 tx=0x7f1028007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:42.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.170+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f102407a170 con 0x7f1034073120 2024-09-10T09:23:42.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.343+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1034155270 con 0x7f101406c010 2024-09-10T09:23:42.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.344+0000 7f1022ffd640 1 -- 172.21.15.12:0/1200845083 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13490 (secure 0 0 0) 0x7f1034155270 con 0x7f101406c010 2024-09-10T09:23:42.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:42.345 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f101406c010 msgr2=0x7f101406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f101406c010 0x7f101406e4d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f10341f5660 tx=0x7f1028007b50 comp rx=0 tx=0).stop 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 msgr2=0x7f1034154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 0x7f1034154d30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f10240097a0 tx=0x7f10240046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 shutdown_connections 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f101406c010 0x7f101406e4d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f103415c180 0x7f10340ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f10340ce230 0x7f10340ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 --2- 172.21.15.12:0/1200845083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1034073120 0x7f1034154d30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 >> 172.21.15.12:0/1200845083 conn(0x7f1034062cc0 msgr2=0x7f10340afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:42.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 shutdown_connections 2024-09-10T09:23:42.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.347+0000 7f1038f11640 1 -- 172.21.15.12:0/1200845083 wait complete. 2024-09-10T09:23:42.359 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-10T09:23:41.235674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220408,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754312,"statfs":{"total":773094113280,"available":772868415488,"internally_reserved":0,"allocated":4268032,"data_stored":2375656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-126192,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-93,"num_write_kb":-161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.900403"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T09:23:36.707391+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:36.707391+0000","last_peered":"2024-09-10T09:23:36.707391+0000","last_clean":"2024-09-10T09:23:36.707391+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:36.707391+0000","last_undegraded":"2024-09-10T09:23:36.707391+0000","last_fullsized":"2024-09-10T09:23:36.707391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":978944,"data_stored":739733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":149365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":739733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:42.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T09:23:42.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.461+0000 7f057b10a640 1 Processor -- start 2024-09-10T09:23:42.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.461+0000 7f057b10a640 1 -- start start 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f057b10a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f057415e860 0x7f05740cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f057b10a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05740b61f0 0x7f05740b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f057b10a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05740b6b50 con 0x7f057406c070 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f057b10a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f05740d34d0 con 0x7f057415e860 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f057b10a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f05740d3790 con 0x7f05740b61f0 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f057415e860 0x7f05740cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f057415e860 0x7f05740cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39410/0 (socket says 172.21.15.12:39410) 2024-09-10T09:23:42.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 -- 172.21.15.12:0/1900960069 learned_addr learned my addr 172.21.15.12:0/1900960069 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:42.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 -- 172.21.15.12:0/1900960069 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05740b61f0 msgr2=0x7f05740b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:42.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 --2- 172.21.15.12:0/1900960069 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05740b61f0 0x7f05740b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 -- 172.21.15.12:0/1900960069 >> v1:172.21.15.100:6789/0 conn(0x7f057406c070 legacy=0x7f057406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:42.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.462+0000 7f0578ea6640 1 -- 172.21.15.12:0/1900960069 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740d3a70 con 0x7f057415e860 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.463+0000 7f0578ea6640 1 --2- 172.21.15.12:0/1900960069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057415e860 0x7f05740cf720 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be40b05a1915b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.463+0000 7f05737fe640 1 -- 172.21.15.12:0/1900960069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564036070 con 0x7f057415e860 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.463+0000 7f05737fe640 1 -- 172.21.15.12:0/1900960069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0564031600 con 0x7f057415e860 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.463+0000 7f05737fe640 1 -- 172.21.15.12:0/1900960069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640319d0 con 0x7f057415e860 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 -- 172.21.15.12:0/1900960069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057415e860 msgr2=0x7f05740cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 --2- 172.21.15.12:0/1900960069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057415e860 0x7f05740cf720 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056402a750 comp rx=0 tx=0).stop 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 -- 172.21.15.12:0/1900960069 shutdown_connections 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 --2- 172.21.15.12:0/1900960069 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05740b61f0 0x7f05740b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 --2- 172.21.15.12:0/1900960069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057415e860 0x7f05740cf720 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 -- 172.21.15.12:0/1900960069 >> 172.21.15.12:0/1900960069 conn(0x7f0574062c60 msgr2=0x7f05740d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 -- 172.21.15.12:0/1900960069 shutdown_connections 2024-09-10T09:23:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.464+0000 7f057b10a640 1 -- 172.21.15.12:0/1900960069 wait complete. 2024-09-10T09:23:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.465+0000 7f057b10a640 1 Processor -- start 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.465+0000 7f057b10a640 1 -- start start 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f057b10a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 0x7f057415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f057b10a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05740b61f0 0x7f05740ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f057b10a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f057415e860 0x7f05741f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f057b10a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05740d4310 con 0x7f057406c070 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f057b10a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05740d4030 con 0x7f05740b61f0 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f057b10a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f057415ec40 con 0x7f057415e860 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 0x7f057415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 0x7f057415ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39420/0 (socket says 172.21.15.12:39420) 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 -- 172.21.15.12:0/1896240230 learned_addr learned my addr 172.21.15.12:0/1896240230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f05796a7640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f057415e860 0x7f05741f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0573fff640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05740b61f0 0x7f05740ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 -- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f057415e860 msgr2=0x7f05741f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f057415e860 0x7f05741f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 -- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05740b61f0 msgr2=0x7f05740ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.466+0000 7f0578ea6640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05740b61f0 0x7f05740ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f0578ea6640 1 -- 172.21.15.12:0/1896240230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740ad1f0 con 0x7f057406c070 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f0573fff640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05740b61f0 0x7f05740ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f0578ea6640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 0x7f057415ddc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f0564004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564036050 con 0x7f057406c070 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0564042070 con 0x7f057406c070 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05740ad4d0 con 0x7f057406c070 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564009510 con 0x7f057406c070 2024-09-10T09:23:42.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.467+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05740ada90 con 0x7f057406c070 2024-09-10T09:23:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.468+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05740b3ad0 con 0x7f057406c070 2024-09-10T09:23:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.469+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f0564007c50 con 0x7f057406c070 2024-09-10T09:23:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.469+0000 7f05717fa640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f056006c010 0x7f056006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.469+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f05640abee0 con 0x7f057406c070 2024-09-10T09:23:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.469+0000 7f0573fff640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f056006c010 0x7f056006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:42.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.470+0000 7f0573fff640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f056006c010 0x7f056006e4d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05740acc00 tx=0x7f0568008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:42.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.473+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f056407a890 con 0x7f057406c070 2024-09-10T09:23:42.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.652+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05740d2700 con 0x7f057406c070 2024-09-10T09:23:42.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.653+0000 7f05717fa640 1 -- 172.21.15.12:0/1896240230 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13044 (secure 0 0 0) 0x7f056407a190 con 0x7f057406c070 2024-09-10T09:23:42.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:42.654 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"b13fea51-e2df-43f6-8889-422976fa1401","created":"2024-09-10T09:22:15.071735+0000","modified":"2024-09-10T09:23:37.339968+0000","last_up_change":"2024-09-10T09:22:26.725863+0000","last_in_change":"2024-09-10T09:22:17.227643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:22:27.264704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a1d0a496-9c65-49d2-aebf-fabbd5f3984e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6809","nonce":902038076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6812","nonce":902038076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6820","nonce":902038076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":902038076},{"type":"v1","addr":"172.21.15.12:6816","nonce":902038076}]},"public_addr":"172.21.15.12:6809/902038076","cluster_addr":"172.21.15.12:6812/902038076","heartbeat_back_addr":"172.21.15.12:6820/902038076","heartbeat_front_addr":"172.21.15.12:6816/902038076","state":["exists","up"]},{"osd":1,"uuid":"50362240-d0e8-4735-af5c-c60ecd6e99fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6813","nonce":3866682510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6817","nonce":3866682510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6823","nonce":3866682510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":3866682510},{"type":"v1","addr":"172.21.15.12:6821","nonce":3866682510}]},"public_addr":"172.21.15.12:6813/3866682510","cluster_addr":"172.21.15.12:6817/3866682510","heartbeat_back_addr":"172.21.15.12:6823/3866682510","heartbeat_front_addr":"172.21.15.12:6821/3866682510","state":["exists","up"]},{"osd":2,"uuid":"2b025bd4-4ff3-4ad8-a82e-b38dec82f142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6801","nonce":2895280715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6803","nonce":2895280715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6807","nonce":2895280715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2895280715},{"type":"v1","addr":"172.21.15.12:6805","nonce":2895280715}]},"public_addr":"172.21.15.12:6801/2895280715","cluster_addr":"172.21.15.12:6803/2895280715","heartbeat_back_addr":"172.21.15.12:6807/2895280715","heartbeat_front_addr":"172.21.15.12:6805/2895280715","state":["exists","up"]},{"osd":3,"uuid":"c1d66922-19a7-4667-9e98-24558ef3f837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6825","nonce":2116037928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6827","nonce":2116037928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6831","nonce":2116037928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2116037928},{"type":"v1","addr":"172.21.15.12:6829","nonce":2116037928}]},"public_addr":"172.21.15.12:6825/2116037928","cluster_addr":"172.21.15.12:6827/2116037928","heartbeat_back_addr":"172.21.15.12:6831/2116037928","heartbeat_front_addr":"172.21.15.12:6829/2116037928","state":["exists","up"]},{"osd":4,"uuid":"fb600a79-7e6f-4a18-aed4-6c89f9cd7b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6817","nonce":3211705705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6819","nonce":3211705705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6823","nonce":3211705705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":3211705705},{"type":"v1","addr":"172.21.15.100:6821","nonce":3211705705}]},"public_addr":"172.21.15.100:6817/3211705705","cluster_addr":"172.21.15.100:6819/3211705705","heartbeat_back_addr":"172.21.15.100:6823/3211705705","heartbeat_front_addr":"172.21.15.100:6821/3211705705","state":["exists","up"]},{"osd":5,"uuid":"b9c37d23-c62c-47da-8357-767f81e5740d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6809","nonce":1581570554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6811","nonce":1581570554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6815","nonce":1581570554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1581570554},{"type":"v1","addr":"172.21.15.100:6813","nonce":1581570554}]},"public_addr":"172.21.15.100:6809/1581570554","cluster_addr":"172.21.15.100:6811/1581570554","heartbeat_back_addr":"172.21.15.100:6815/1581570554","heartbeat_front_addr":"172.21.15.100:6813/1581570554","state":["exists","up"]},{"osd":6,"uuid":"a086eced-fc1a-4d17-8a2a-62eb9afd4581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6801","nonce":2090972208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6803","nonce":2090972208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6807","nonce":2090972208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2090972208},{"type":"v1","addr":"172.21.15.100:6805","nonce":2090972208}]},"public_addr":"172.21.15.100:6801/2090972208","cluster_addr":"172.21.15.100:6803/2090972208","heartbeat_back_addr":"172.21.15.100:6807/2090972208","heartbeat_front_addr":"172.21.15.100:6805/2090972208","state":["exists","up"]},{"osd":7,"uuid":"f8ed8da4-343f-4733-86fd-ec505d12ad08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6825","nonce":4121682080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6827","nonce":4121682080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6831","nonce":4121682080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4121682080},{"type":"v1","addr":"172.21.15.100:6829","nonce":4121682080}]},"public_addr":"172.21.15.100:6825/4121682080","cluster_addr":"172.21.15.100:6827/4121682080","heartbeat_back_addr":"172.21.15.100:6831/4121682080","heartbeat_front_addr":"172.21.15.100:6829/4121682080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.314315+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.201146+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.357192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:24.338828+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.815542+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.711733+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:22:23.984915+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6836/694322310":"2024-09-11T09:23:34.323641+0000","172.21.15.100:6834/694322310":"2024-09-11T09:23:34.323641+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f056006c010 msgr2=0x7f056006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f056006c010 0x7f056006e4d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05740acc00 tx=0x7f0568008040 comp rx=0 tx=0).stop 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 msgr2=0x7f057415ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 0x7f057415ddc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f0564004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 shutdown_connections 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f056006c010 0x7f056006e4d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f057415e860 0x7f05741f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05740b61f0 0x7f05740ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 --2- 172.21.15.12:0/1896240230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f057406c070 0x7f057415ddc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 >> 172.21.15.12:0/1896240230 conn(0x7f0574062c60 msgr2=0x7f057406c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 shutdown_connections 2024-09-10T09:23:42.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:42.655+0000 7f057b10a640 1 -- 172.21.15.12:0/1896240230 wait complete. 2024-09-10T09:23:43.668 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T09:23:43.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:43.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.788+0000 7fa591837640 1 Processor -- start 2024-09-10T09:23:43.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.788+0000 7fa591837640 1 -- start start 2024-09-10T09:23:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa591837640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa58c15eb10 0x7fa58c06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa591837640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c070d30 0x7fa58c0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa591837640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa58c0d24f0 0x7fa58c0d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa591837640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c0b5be0 con 0x7fa58c15eb10 2024-09-10T09:23:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa591837640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c06e5d0 con 0x7fa58c0d24f0 2024-09-10T09:23:43.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa591837640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c0d2ea0 con 0x7fa58c070d30 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa58c15eb10 0x7fa58c06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa58c15eb10 0x7fa58c06ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39434/0 (socket says 172.21.15.12:39434) 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 -- 172.21.15.12:0/2485713277 learned_addr learned my addr 172.21.15.12:0/2485713277 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58b7fe640 1 --2- 172.21.15.12:0/2485713277 >> v2:172.21.15.100:3300/0 conn(0x7fa58c0d24f0 0x7fa58c0d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58a7fc640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c070d30 0x7fa58c0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 -- 172.21.15.12:0/2485713277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c070d30 msgr2=0x7fa58c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c070d30 0x7fa58c0b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 -- 172.21.15.12:0/2485713277 >> v2:172.21.15.100:3300/0 conn(0x7fa58c0d24f0 msgr2=0x7fa58c0d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 --2- 172.21.15.12:0/2485713277 >> v2:172.21.15.100:3300/0 conn(0x7fa58c0d24f0 0x7fa58c0d2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58affd640 1 -- 172.21.15.12:0/2485713277 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c071170 con 0x7fa58c15eb10 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58b7fe640 1 --2- 172.21.15.12:0/2485713277 >> v2:172.21.15.100:3300/0 conn(0x7fa58c0d24f0 0x7fa58c0d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:43.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.789+0000 7fa58a7fc640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c070d30 0x7fa58c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.790+0000 7fa58affd640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c15eb10 0x7fa58c06ccb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0d3180 tx=0x7fa58402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb803f5d73855cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.790+0000 7fa589ffb640 1 -- 172.21.15.12:0/2485713277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584037070 con 0x7fa58c15eb10 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.790+0000 7fa589ffb640 1 -- 172.21.15.12:0/2485713277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584032440 con 0x7fa58c15eb10 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.790+0000 7fa589ffb640 1 -- 172.21.15.12:0/2485713277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584032810 con 0x7fa58c15eb10 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 -- 172.21.15.12:0/2485713277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c15eb10 msgr2=0x7fa58c06ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c15eb10 0x7fa58c06ccb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0d3180 tx=0x7fa58402a1e0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 -- 172.21.15.12:0/2485713277 shutdown_connections 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 --2- 172.21.15.12:0/2485713277 >> v2:172.21.15.100:3300/0 conn(0x7fa58c0d24f0 0x7fa58c0d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c070d30 0x7fa58c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 --2- 172.21.15.12:0/2485713277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c15eb10 0x7fa58c06ccb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 -- 172.21.15.12:0/2485713277 >> 172.21.15.12:0/2485713277 conn(0x7fa58c06f370 msgr2=0x7fa58c06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:43.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 -- 172.21.15.12:0/2485713277 shutdown_connections 2024-09-10T09:23:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.791+0000 7fa591837640 1 -- 172.21.15.12:0/2485713277 wait complete. 2024-09-10T09:23:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.792+0000 7fa591837640 1 Processor -- start 2024-09-10T09:23:43.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.792+0000 7fa591837640 1 -- start start 2024-09-10T09:23:43.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa591837640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa58c070d30 0x7fa58c13cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa591837640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c0d24f0 0x7fa58c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa591837640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c15eb10 0x7fa58c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa591837640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06e820 con 0x7fa58c0d24f0 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa591837640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c071a40 con 0x7fa58c070d30 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa591837640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c06eb00 con 0x7fa58c15eb10 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa58a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c0d24f0 0x7fa58c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa58a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c0d24f0 0x7fa58c1506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39446/0 (socket says 172.21.15.12:39446) 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa58a7fc640 1 -- 172.21.15.12:0/564400851 learned_addr learned my addr 172.21.15.12:0/564400851 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa58affd640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa58c070d30 0x7fa58c13cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.793+0000 7fa58b7fe640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c15eb10 0x7fa58c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58a7fc640 1 -- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c15eb10 msgr2=0x7fa58c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58a7fc640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c15eb10 0x7fa58c150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58a7fc640 1 -- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa58c070d30 msgr2=0x7fa58c13cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58a7fc640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa58c070d30 0x7fa58c13cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58a7fc640 1 -- 172.21.15.12:0/564400851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c153250 con 0x7fa58c0d24f0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58b7fe640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa58c15eb10 0x7fa58c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa58a7fc640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c0d24f0 0x7fa58c1506b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c7f0 tx=0x7fa57400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574004230 con 0x7fa58c0d24f0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5740043f0 con 0x7fa58c0d24f0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c153530 con 0x7fa58c0d24f0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574007860 con 0x7fa58c0d24f0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.794+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c160320 con 0x7fa58c0d24f0 2024-09-10T09:23:43.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.795+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa58c153a50 con 0x7fa58c0d24f0 2024-09-10T09:23:43.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fa574007c10 con 0x7fa58c0d24f0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa583fff640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa56c06bfe0 0x7fa56c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fa57408b270 con 0x7fa58c0d24f0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa583fff640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fa56c071ea0 0x7fa56c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 --> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa57401de50 con 0x7fa56c071ea0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa574092050 con 0x7fa58c0d24f0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa58affd640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa56c06bfe0 0x7fa56c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.796+0000 7fa58b7fe640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fa56c071ea0 0x7fa56c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.797+0000 7fa58b7fe640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fa56c071ea0 0x7fa56c0742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.797+0000 7fa58affd640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa56c06bfe0 0x7fa56c06e4a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa584034000 tx=0x7fa58402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.798+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== osd.0 v2:172.21.15.12:6808/902038076 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa57401de50 con 0x7fa56c071ea0 2024-09-10T09:23:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.810+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 --> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa58c0d2960 con 0x7fa56c071ea0 2024-09-10T09:23:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa583fff640 1 -- 172.21.15.12:0/564400851 <== osd.0 v2:172.21.15.12:6808/902038076 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa58c0d2960 con 0x7fa56c071ea0 2024-09-10T09:23:43.811 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:43.812 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:43.812 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fa56c071ea0 msgr2=0x7fa56c0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:6808/902038076,v1:172.21.15.12:6809/902038076] conn(0x7fa56c071ea0 0x7fa56c0742c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa56c06bfe0 msgr2=0x7fa56c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa56c06bfe0 0x7fa56c06e4a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa584034000 tx=0x7fa58402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c0d24f0 msgr2=0x7fa58c1506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 --2- 172.21.15.12:0/564400851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa58c0d24f0 0x7fa58c1506b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c7f0 tx=0x7fa57400ccb0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa58b7fe640 1 -- 172.21.15.12:0/564400851 reap_dead start 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 shutdown_connections 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 >> 172.21.15.12:0/564400851 conn(0x7fa58c06f370 msgr2=0x7fa58c0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 shutdown_connections 2024-09-10T09:23:43.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.811+0000 7fa591837640 1 -- 172.21.15.12:0/564400851 wait complete. 2024-09-10T09:23:43.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T09:23:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.926+0000 7fab51f13640 1 Processor -- start 2024-09-10T09:23:43.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.926+0000 7fab51f13640 1 -- start start 2024-09-10T09:23:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab51f13640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab4c0b61f0 0x7fab4c0b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab51f13640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b7aa0 0x7fab4c0b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab51f13640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c0d34d0 con 0x7fab4c15e860 2024-09-10T09:23:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab51f13640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fab4c0b6b80 con 0x7fab4c0b61f0 2024-09-10T09:23:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab51f13640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c0d3790 con 0x7fab4c0b7aa0 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab4affd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab4c0b61f0 0x7fab4c0b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab4affd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab4c0b61f0 0x7fab4c0b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:54776/0 (socket says 172.21.15.12:54776) 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab4affd640 1 -- 172.21.15.12:0/2665675496 learned_addr learned my addr 172.21.15.12:0/2665675496 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.927+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b7aa0 0x7fab4c0b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.928+0000 7fab4affd640 1 -- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b7aa0 msgr2=0x7fab4c0b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.928+0000 7fab4affd640 1 --2- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b7aa0 0x7fab4c0b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.928+0000 7fab4affd640 1 -- 172.21.15.12:0/2665675496 >> v1:172.21.15.100:6789/0 conn(0x7fab4c15e860 legacy=0x7fab4c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.928+0000 7fab4a7fc640 1 -- 172.21.15.12:0/2665675496 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268082786 0 0) 0x7fab4c0d34d0 con 0x7fab4c15e860 2024-09-10T09:23:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.928+0000 7fab4affd640 1 -- 172.21.15.12:0/2665675496 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c0d3a70 con 0x7fab4c0b61f0 2024-09-10T09:23:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.928+0000 7fab4affd640 1 --2- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b61f0 0x7fab4c0b6640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab40009870 tx=0x7fab4002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9a7bfb3c1c06d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab4a7fc640 1 -- 172.21.15.12:0/2665675496 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40037070 con 0x7fab4c0b61f0 2024-09-10T09:23:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab4a7fc640 1 -- 172.21.15.12:0/2665675496 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4002ae50 con 0x7fab4c0b61f0 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab4a7fc640 1 -- 172.21.15.12:0/2665675496 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40032860 con 0x7fab4c0b61f0 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 -- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b61f0 msgr2=0x7fab4c0b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 --2- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b61f0 0x7fab4c0b6640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab40009870 tx=0x7fab4002a300 comp rx=0 tx=0).stop 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 -- 172.21.15.12:0/2665675496 shutdown_connections 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 --2- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b61f0 0x7fab4c0b6640 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 --2- 172.21.15.12:0/2665675496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b7aa0 0x7fab4c0b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 -- 172.21.15.12:0/2665675496 >> 172.21.15.12:0/2665675496 conn(0x7fab4c062c60 msgr2=0x7fab4c0d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 -- 172.21.15.12:0/2665675496 shutdown_connections 2024-09-10T09:23:43.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.929+0000 7fab51f13640 1 -- 172.21.15.12:0/2665675496 wait complete. 2024-09-10T09:23:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.930+0000 7fab51f13640 1 Processor -- start 2024-09-10T09:23:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 -- start start 2024-09-10T09:23:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b61f0 0x7fab4c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b7aa0 0x7fab4c0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 0x7fab4c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0d4310 con 0x7fab4c15e860 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0d4030 con 0x7fab4c0b7aa0 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab51f13640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c15ec40 con 0x7fab4c0b61f0 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 0x7fab4c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 0x7fab4c15ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39456/0 (socket says 172.21.15.12:39456) 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.931+0000 7fab4bfff640 1 -- 172.21.15.12:0/1001654644 learned_addr learned my addr 172.21.15.12:0/1001654644 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4affd640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b7aa0 0x7fab4c0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4b7fe640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b61f0 0x7fab4c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4bfff640 1 -- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b61f0 msgr2=0x7fab4c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4bfff640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b61f0 0x7fab4c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4bfff640 1 -- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b7aa0 msgr2=0x7fab4c0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4bfff640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b7aa0 0x7fab4c0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4bfff640 1 -- 172.21.15.12:0/1001654644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c1f7b90 con 0x7fab4c15e860 2024-09-10T09:23:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab4bfff640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 0x7fab4c15ce20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fab4400efc0 tx=0x7fab4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44018020 con 0x7fab4c15e860 2024-09-10T09:23:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab44014480 con 0x7fab4c15e860 2024-09-10T09:23:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44014870 con 0x7fab4c15e860 2024-09-10T09:23:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c1f7e70 con 0x7fab4c15e860 2024-09-10T09:23:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.932+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c1f8430 con 0x7fab4c15e860 2024-09-10T09:23:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.933+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c0b3ad0 con 0x7fab4c15e860 2024-09-10T09:23:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.934+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fab44005d10 con 0x7fab4c15e860 2024-09-10T09:23:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.934+0000 7fab33fff640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab3806bfe0 0x7fab3806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.934+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fab4408bcc0 con 0x7fab4c15e860 2024-09-10T09:23:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.935+0000 7fab4b7fe640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab3806bfe0 0x7fab3806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.935+0000 7fab4b7fe640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab3806bfe0 0x7fab3806e4a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000f60 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:43.939+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab44022030 con 0x7fab4c15e860 2024-09-10T09:23:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.115+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fab4c0d2700 con 0x7fab3806bfe0 2024-09-10T09:23:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.116+0000 7fab33fff640 1 -- 172.21.15.12:0/1001654644 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fab4c0d2700 con 0x7fab3806bfe0 2024-09-10T09:23:44.116 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T09:23:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab3806bfe0 msgr2=0x7fab3806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab3806bfe0 0x7fab3806e4a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000f60 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2024-09-10T09:23:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 msgr2=0x7fab4c15ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 0x7fab4c15ce20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fab4400efc0 tx=0x7fab4400c490 comp rx=0 tx=0).stop 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 shutdown_connections 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fab3806bfe0 0x7fab3806e4a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c15e860 0x7fab4c15ce20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab4c0b7aa0 0x7fab4c0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 --2- 172.21.15.12:0/1001654644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab4c0b61f0 0x7fab4c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 >> 172.21.15.12:0/1001654644 conn(0x7fab4c062c60 msgr2=0x7fab4c0b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 shutdown_connections 2024-09-10T09:23:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.118+0000 7fab51f13640 1 -- 172.21.15.12:0/1001654644 wait complete. 2024-09-10T09:23:44.130 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T09:23:44.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:44.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.236+0000 7fb8e613b640 1 Processor -- start 2024-09-10T09:23:44.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.236+0000 7fb8e613b640 1 -- start start 2024-09-10T09:23:44.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8e613b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8e015e770 0x7fb8e00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8e613b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 0x7fb8e00b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8e613b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e00b6b30 con 0x7fb8e00b3970 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8e613b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e015eb50 con 0x7fb8e015e770 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8e613b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e00b3de0 con 0x7fb8e00b6710 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 0x7fb8e00b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8df7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8e015e770 0x7fb8e00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 0x7fb8e00b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:40088/0 (socket says 172.21.15.12:40088) 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8dffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb8e00b3970 0x7fb8e006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:47326/0 (socket says 172.21.15.12:47326) 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8df7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8e015e770 0x7fb8e00b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:54786/0 (socket says 172.21.15.12:54786) 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.237+0000 7fb8deffd640 1 -- 172.21.15.12:0/427429604 learned_addr learned my addr 172.21.15.12:0/427429604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.238+0000 7fb8df7fe640 1 -- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 msgr2=0x7fb8e00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.238+0000 7fb8df7fe640 1 --2- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 0x7fb8e00b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.238+0000 7fb8df7fe640 1 -- 172.21.15.12:0/427429604 >> v1:172.21.15.100:6789/0 conn(0x7fb8e00b3970 legacy=0x7fb8e006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.238+0000 7fb8df7fe640 1 -- 172.21.15.12:0/427429604 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e00d43b0 con 0x7fb8e015e770 2024-09-10T09:23:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.238+0000 7fb8deffd640 1 --2- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 0x7fb8e00b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.239+0000 7fb8df7fe640 1 --2- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e015e770 0x7fb8e00b61d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00097d0 tx=0x7fb8d002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ca6cdfe43a13685 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.239+0000 7fb8de7fc640 1 -- 172.21.15.12:0/427429604 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0037070 con 0x7fb8e015e770 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.239+0000 7fb8de7fc640 1 -- 172.21.15.12:0/427429604 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d002ae40 con 0x7fb8e015e770 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.239+0000 7fb8de7fc640 1 -- 172.21.15.12:0/427429604 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0032660 con 0x7fb8e015e770 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 -- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e015e770 msgr2=0x7fb8e00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 --2- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e015e770 0x7fb8e00b61d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00097d0 tx=0x7fb8d002a130 comp rx=0 tx=0).stop 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 -- 172.21.15.12:0/427429604 shutdown_connections 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 --2- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b6710 0x7fb8e00b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 --2- 172.21.15.12:0/427429604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e015e770 0x7fb8e00b61d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 -- 172.21.15.12:0/427429604 >> 172.21.15.12:0/427429604 conn(0x7fb8e0062a50 msgr2=0x7fb8e0062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 -- 172.21.15.12:0/427429604 shutdown_connections 2024-09-10T09:23:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.240+0000 7fb8e613b640 1 -- 172.21.15.12:0/427429604 wait complete. 2024-09-10T09:23:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.241+0000 7fb8e613b640 1 Processor -- start 2024-09-10T09:23:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.241+0000 7fb8e613b640 1 -- start start 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8e613b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b3970 0x7fb8e0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8e613b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e00b6710 0x7fb8e015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8e613b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8e015e770 0x7fb8e00c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8e613b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00d28c0 con 0x7fb8e015e770 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8e613b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00d25e0 con 0x7fb8e00b6710 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8e613b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e00d2ba0 con 0x7fb8e00b3970 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8e015e770 0x7fb8e00c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8e015e770 0x7fb8e00c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39468/0 (socket says 172.21.15.12:39468) 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 -- 172.21.15.12:0/241556554 learned_addr learned my addr 172.21.15.12:0/241556554 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8deffd640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e00b6710 0x7fb8e015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8df7fe640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b3970 0x7fb8e0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 -- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b3970 msgr2=0x7fb8e0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8e00b3970 0x7fb8e0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 -- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e00b6710 msgr2=0x7fb8e015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e00b6710 0x7fb8e015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.242+0000 7fb8dffff640 1 -- 172.21.15.12:0/241556554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e015f720 con 0x7fb8e015e770 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.243+0000 7fb8dffff640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8e015e770 0x7fb8e00c9e90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800c740 tx=0x7fb8d800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.243+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8017070 con 0x7fb8e015e770 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.243+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d800ce50 con 0x7fb8e015e770 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.243+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e015fa00 con 0x7fb8e015e770 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.243+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800a860 con 0x7fb8e015e770 2024-09-10T09:23:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.243+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e0155490 con 0x7fb8e015e770 2024-09-10T09:23:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.244+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8e0161f10 con 0x7fb8e015e770 2024-09-10T09:23:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.244+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb8d801a070 con 0x7fb8e015e770 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8c7fff640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb8cc06bfe0 0x7fb8cc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fb8d808a340 con 0x7fb8e015e770 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8c7fff640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fb8cc071ea0 0x7fb8cc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 --> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8cc074970 con 0x7fb8cc071ea0 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb8d8091050 con 0x7fb8e015e770 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8df7fe640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb8cc06bfe0 0x7fb8cc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8deffd640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fb8cc071ea0 0x7fb8cc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.245+0000 7fb8deffd640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fb8cc071ea0 0x7fb8cc0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.246+0000 7fb8df7fe640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb8cc06bfe0 0x7fb8cc06e4a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0034000 tx=0x7fb8d002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.246+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== osd.1 v2:172.21.15.12:6811/3866682510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8cc074970 con 0x7fb8cc071ea0 2024-09-10T09:23:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 --> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8e00d2e80 con 0x7fb8cc071ea0 2024-09-10T09:23:44.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8c7fff640 1 -- 172.21.15.12:0/241556554 <== osd.1 v2:172.21.15.12:6811/3866682510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8e00d2e80 con 0x7fb8cc071ea0 2024-09-10T09:23:44.260 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:44.260 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:44.260 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fb8cc071ea0 msgr2=0x7fb8cc0742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:6811/3866682510,v1:172.21.15.12:6813/3866682510] conn(0x7fb8cc071ea0 0x7fb8cc0742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb8cc06bfe0 msgr2=0x7fb8cc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fb8cc06bfe0 0x7fb8cc06e4a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0034000 tx=0x7fb8d002e000 comp rx=0 tx=0).stop 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8e015e770 msgr2=0x7fb8e00c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 --2- 172.21.15.12:0/241556554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8e015e770 0x7fb8e00c9e90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800c740 tx=0x7fb8d800cc00 comp rx=0 tx=0).stop 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8dffff640 1 -- 172.21.15.12:0/241556554 reap_dead start 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 shutdown_connections 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 >> 172.21.15.12:0/241556554 conn(0x7fb8e0062a50 msgr2=0x7fb8e015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 shutdown_connections 2024-09-10T09:23:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.259+0000 7fb8e613b640 1 -- 172.21.15.12:0/241556554 wait complete. 2024-09-10T09:23:44.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T09:23:44.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.373+0000 7f941dfb7640 1 Processor -- start 2024-09-10T09:23:44.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.374+0000 7f941dfb7640 1 -- start start 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.374+0000 7f941dfb7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f941815c690 0x7f94180b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.374+0000 7f941dfb7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f94180d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.374+0000 7f941dfb7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9418073da0 con 0x7f94180d0a80 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.374+0000 7f941dfb7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9418074060 con 0x7f941815c690 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.374+0000 7f941dfb7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f94180b6aa0 con 0x7f94180b1980 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f9417fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f94180d0a80 0x7f94180b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58444/0 (socket says 172.21.15.12:58444) 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f9417fff640 1 -- 172.21.15.12:0/1645751374 learned_addr learned my addr 172.21.15.12:0/1645751374 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f94177fe640 1 --2- 172.21.15.12:0/1645751374 >> v2:172.21.15.100:3300/0 conn(0x7f941815c690 0x7f94180b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f940effd640 1 --2- 172.21.15.12:0/1645751374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f94180d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f9416ffd640 1 -- 172.21.15.12:0/1645751374 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821773088 0 0) 0x7f9418073da0 con 0x7f94180d0a80 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f9416ffd640 1 -- 172.21.15.12:0/1645751374 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9404003520 con 0x7f94180d0a80 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f9416ffd640 1 -- 172.21.15.12:0/1645751374 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2474074800 0 0) 0x7f9404003520 con 0x7f94180d0a80 2024-09-10T09:23:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f940effd640 1 -- 172.21.15.12:0/1645751374 >> v2:172.21.15.100:3300/0 conn(0x7f941815c690 msgr2=0x7f94180b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f940effd640 1 --2- 172.21.15.12:0/1645751374 >> v2:172.21.15.100:3300/0 conn(0x7f941815c690 0x7f94180b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f940effd640 1 -- 172.21.15.12:0/1645751374 >> v1:172.21.15.12:6789/0 conn(0x7f94180d0a80 legacy=0x7f94180b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.375+0000 7f940effd640 1 -- 172.21.15.12:0/1645751374 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94180733a0 con 0x7f94180b1980 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.376+0000 7f940effd640 1 --2- 172.21.15.12:0/1645751374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f94180d0540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94000097a0 tx=0x7f940002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc21a35a3869b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.376+0000 7f9416ffd640 1 -- 172.21.15.12:0/1645751374 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400037070 con 0x7f94180b1980 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.376+0000 7f9416ffd640 1 -- 172.21.15.12:0/1645751374 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940002aba0 con 0x7f94180b1980 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.376+0000 7f9416ffd640 1 -- 172.21.15.12:0/1645751374 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94100019f0 con 0x7f94180b1980 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 -- 172.21.15.12:0/1645751374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 msgr2=0x7f94180d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1645751374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f94180d0540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94000097a0 tx=0x7f940002a110 comp rx=0 tx=0).stop 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 -- 172.21.15.12:0/1645751374 shutdown_connections 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1645751374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f94180d0540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1645751374 >> v2:172.21.15.100:3300/0 conn(0x7f941815c690 0x7f94180b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 -- 172.21.15.12:0/1645751374 >> 172.21.15.12:0/1645751374 conn(0x7f9418062630 msgr2=0x7f9418062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 -- 172.21.15.12:0/1645751374 shutdown_connections 2024-09-10T09:23:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.377+0000 7f941dfb7640 1 -- 172.21.15.12:0/1645751374 wait complete. 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.378+0000 7f941dfb7640 1 Processor -- start 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.378+0000 7f941dfb7640 1 -- start start 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f941dfb7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f9418145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f941dfb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 0x7f9418150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f941dfb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f941815c690 0x7f9418151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f941dfb7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f94180b4b20 con 0x7f94180d0a80 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f941dfb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f94180b49a0 con 0x7f941815c690 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f941dfb7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f94180b6fc0 con 0x7f94180b1980 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 0x7f9418150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 0x7f9418150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39482/0 (socket says 172.21.15.12:39482) 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 -- 172.21.15.12:0/1964843120 learned_addr learned my addr 172.21.15.12:0/1964843120 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f94177fe640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f9418145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f9417fff640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f941815c690 0x7f9418151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 -- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 msgr2=0x7f9418145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f9418145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 -- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f941815c690 msgr2=0x7f9418151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f941815c690 0x7f9418151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 -- 172.21.15.12:0/1964843120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418151420 con 0x7f94180d0a80 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.379+0000 7f940effd640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 0x7f9418150430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9400035040 tx=0x7f94000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.380+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400041020 con 0x7f94180d0a80 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.380+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940003d620 con 0x7f94180d0a80 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.380+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9418150e60 con 0x7f94180d0a80 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.380+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400037040 con 0x7f94180d0a80 2024-09-10T09:23:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.380+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941815cd20 con 0x7f94180d0a80 2024-09-10T09:23:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.381+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94180d0540 con 0x7f94180d0a80 2024-09-10T09:23:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.381+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f9400044020 con 0x7f94180d0a80 2024-09-10T09:23:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.382+0000 7f9414ff9640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f93f806c010 0x7f93f806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.382+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f94000ab2f0 con 0x7f94180d0a80 2024-09-10T09:23:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.382+0000 7f94177fe640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f93f806c010 0x7f93f806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.382+0000 7f94177fe640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f93f806c010 0x7f93f806e4d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9408009aa0 tx=0x7f9408009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.386+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f940004b030 con 0x7f94180d0a80 2024-09-10T09:23:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.561+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f941815a7f0 con 0x7f93f806c010 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.562+0000 7f9414ff9640 1 -- 172.21.15.12:0/1964843120 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f941815a7f0 con 0x7f93f806c010 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f93f806c010 msgr2=0x7f93f806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f93f806c010 0x7f93f806e4d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9408009aa0 tx=0x7f9408009190 comp rx=0 tx=0).stop 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 msgr2=0x7f9418150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 0x7f9418150430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9400035040 tx=0x7f94000046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 shutdown_connections 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f93f806c010 0x7f93f806e4d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f941815c690 0x7f9418151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94180d0a80 0x7f9418150430 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.563+0000 7f941dfb7640 1 --2- 172.21.15.12:0/1964843120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94180b1980 0x7f9418145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.564+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 >> 172.21.15.12:0/1964843120 conn(0x7f9418062630 msgr2=0x7f94180d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.564+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 shutdown_connections 2024-09-10T09:23:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.564+0000 7f941dfb7640 1 -- 172.21.15.12:0/1964843120 wait complete. 2024-09-10T09:23:44.575 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T09:23:44.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.682+0000 7fae0598d640 1 Processor -- start 2024-09-10T09:23:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.682+0000 7fae0598d640 1 -- start start 2024-09-10T09:23:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fae0598d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae000b3b00 0x7fae000d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fae0598d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fae0598d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae000d20e0 con 0x7fae000b61e0 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fae0598d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fae000d24f0 con 0x7fae000b3b00 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fae0598d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fae000cfa70 con 0x7fae000b3540 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae000b3b00 0x7fae000d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae000b3b00 0x7fae000d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39494/0 (socket says 172.21.15.12:39494) 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 -- 172.21.15.12:0/889443074 learned_addr learned my addr 172.21.15.12:0/889443074 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 -- 172.21.15.12:0/889443074 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 msgr2=0x7fae000d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 --2- 172.21.15.12:0/889443074 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 -- 172.21.15.12:0/889443074 >> v1:172.21.15.100:6789/0 conn(0x7fae000b61e0 legacy=0x7fae000b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.683+0000 7fadf7fff640 1 -- 172.21.15.12:0/889443074 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae000cfd50 con 0x7fae000b3b00 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.684+0000 7fadf7fff640 1 --2- 172.21.15.12:0/889443074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b3b00 0x7fae000d2980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fade8009870 tx=0x7fade802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6eb868aa5f6932 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.684+0000 7fadfe7fc640 1 -- 172.21.15.12:0/889443074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8037070 con 0x7fae000b3b00 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.684+0000 7fadfe7fc640 1 -- 172.21.15.12:0/889443074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade802ae10 con 0x7fae000b3b00 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.684+0000 7fadfe7fc640 1 -- 172.21.15.12:0/889443074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8032660 con 0x7fae000b3b00 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 -- 172.21.15.12:0/889443074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b3b00 msgr2=0x7fae000d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 --2- 172.21.15.12:0/889443074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b3b00 0x7fae000d2980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fade8009870 tx=0x7fade802a100 comp rx=0 tx=0).stop 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 -- 172.21.15.12:0/889443074 shutdown_connections 2024-09-10T09:23:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 --2- 172.21.15.12:0/889443074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b3b00 0x7fae000d2980 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 --2- 172.21.15.12:0/889443074 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 -- 172.21.15.12:0/889443074 >> 172.21.15.12:0/889443074 conn(0x7fae000d11e0 msgr2=0x7fae000d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 -- 172.21.15.12:0/889443074 shutdown_connections 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.685+0000 7fae0598d640 1 -- 172.21.15.12:0/889443074 wait complete. 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.686+0000 7fae0598d640 1 Processor -- start 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.686+0000 7fae0598d640 1 -- start start 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fae0598d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fae0598d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae000b3b00 0x7fae0014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fae0598d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b61e0 0x7fae000cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fae0598d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae0015edc0 con 0x7fae000b61e0 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fae0598d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae000d1d00 con 0x7fae000b3b00 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fae0598d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fae000d4040 con 0x7fae000b3540 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b61e0 0x7fae000cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b61e0 0x7fae000cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39510/0 (socket says 172.21.15.12:39510) 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 -- 172.21.15.12:0/4279290968 learned_addr learned my addr 172.21.15.12:0/4279290968 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadf7fff640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae000b3b00 0x7fae0014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 -- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 msgr2=0x7fae000d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadfeffd640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 -- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae000b3b00 msgr2=0x7fae0014fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae000b3b00 0x7fae0014fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 -- 172.21.15.12:0/4279290968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae00150180 con 0x7fae000b61e0 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadf7fff640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae000b3b00 0x7fae0014fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadfeffd640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae000b3540 0x7fae000d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.687+0000 7fadff7fe640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b61e0 0x7fae000cd370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fadf800b970 tx=0x7fadf800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.688+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8019070 con 0x7fae000b61e0 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.688+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf800cb60 con 0x7fae000b61e0 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.688+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae000cc3c0 con 0x7fae000b61e0 2024-09-10T09:23:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.688+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8014440 con 0x7fae000b61e0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.688+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae000cc960 con 0x7fae000b61e0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.688+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae000ccba0 con 0x7fae000b61e0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.689+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fadf801c070 con 0x7fae000b61e0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadfcff9640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fade006bfe0 0x7fade006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fadf808b310 con 0x7fae000b61e0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadfcff9640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7fade0071ea0 0x7fade00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 --> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadf8022ec0 con 0x7fade0071ea0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fadf808b7a0 con 0x7fae000b61e0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadfeffd640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fade006bfe0 0x7fade006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadf7fff640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7fade0071ea0 0x7fade00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.690+0000 7fadf7fff640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7fade0071ea0 0x7fade00742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.691+0000 7fadfeffd640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fade006bfe0 0x7fade006e4a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fadf000a810 tx=0x7fadf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.691+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== osd.2 v2:172.21.15.12:6800/2895280715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fadf8022ec0 con 0x7fade0071ea0 2024-09-10T09:23:44.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 --> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae000b65c0 con 0x7fade0071ea0 2024-09-10T09:23:44.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fadfcff9640 1 -- 172.21.15.12:0/4279290968 <== osd.2 v2:172.21.15.12:6800/2895280715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae000b65c0 con 0x7fade0071ea0 2024-09-10T09:23:44.705 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:44.706 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:44.706 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7fade0071ea0 msgr2=0x7fade00742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:6800/2895280715,v1:172.21.15.12:6801/2895280715] conn(0x7fade0071ea0 0x7fade00742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fade006bfe0 msgr2=0x7fade006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fade006bfe0 0x7fade006e4a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fadf000a810 tx=0x7fadf0008040 comp rx=0 tx=0).stop 2024-09-10T09:23:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b61e0 msgr2=0x7fae000cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 --2- 172.21.15.12:0/4279290968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae000b61e0 0x7fae000cd370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fadf800b970 tx=0x7fadf800be30 comp rx=0 tx=0).stop 2024-09-10T09:23:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fadff7fe640 1 -- 172.21.15.12:0/4279290968 reap_dead start 2024-09-10T09:23:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 shutdown_connections 2024-09-10T09:23:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 >> 172.21.15.12:0/4279290968 conn(0x7fae000d11e0 msgr2=0x7fae0015ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 shutdown_connections 2024-09-10T09:23:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.704+0000 7fae0598d640 1 -- 172.21.15.12:0/4279290968 wait complete. 2024-09-10T09:23:44.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T09:23:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.819+0000 7fdc4bb96640 1 Processor -- start 2024-09-10T09:23:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.819+0000 7fdc4bb96640 1 -- start start 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4bb96640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc4415e500 0x7fdc440b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4bb96640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc4415e8e0 0x7fdc440b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4bb96640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc44073cb0 0x7fdc441622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4bb96640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdc44074200 con 0x7fdc44073cb0 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4bb96640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdc440b6e80 con 0x7fdc4415e8e0 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4bb96640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdc440b7160 con 0x7fdc4415e500 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc44073cb0 0x7fdc441622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc44073cb0 0x7fdc441622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39514/0 (socket says 172.21.15.12:39514) 2024-09-10T09:23:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 -- 172.21.15.12:0/3765303264 learned_addr learned my addr 172.21.15.12:0/3765303264 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc49131640 1 --2- 172.21.15.12:0/3765303264 >> v2:172.21.15.100:3300/0 conn(0x7fdc4415e8e0 0x7fdc440b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc49932640 1 --2- 172.21.15.12:0/3765303264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc4415e500 0x7fdc440b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 -- 172.21.15.12:0/3765303264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc4415e500 msgr2=0x7fdc440b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 --2- 172.21.15.12:0/3765303264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc4415e500 0x7fdc440b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 -- 172.21.15.12:0/3765303264 >> v2:172.21.15.100:3300/0 conn(0x7fdc4415e8e0 msgr2=0x7fdc440b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 --2- 172.21.15.12:0/3765303264 >> v2:172.21.15.100:3300/0 conn(0x7fdc4415e8e0 0x7fdc440b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.820+0000 7fdc4a133640 1 -- 172.21.15.12:0/3765303264 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc440b7440 con 0x7fdc44073cb0 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.821+0000 7fdc4a133640 1 --2- 172.21.15.12:0/3765303264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc44073cb0 0x7fdc441622a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdc44063540 tx=0x7fdc3c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4741df2151ef09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.821+0000 7fdc48930640 1 -- 172.21.15.12:0/3765303264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c036070 con 0x7fdc44073cb0 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.821+0000 7fdc48930640 1 -- 172.21.15.12:0/3765303264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c031600 con 0x7fdc44073cb0 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.821+0000 7fdc48930640 1 -- 172.21.15.12:0/3765303264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0319d0 con 0x7fdc44073cb0 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3765303264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc44073cb0 msgr2=0x7fdc441622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3765303264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc44073cb0 0x7fdc441622a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdc44063540 tx=0x7fdc3c02a610 comp rx=0 tx=0).stop 2024-09-10T09:23:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3765303264 shutdown_connections 2024-09-10T09:23:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3765303264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc44073cb0 0x7fdc441622a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3765303264 >> v2:172.21.15.100:3300/0 conn(0x7fdc4415e8e0 0x7fdc440b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3765303264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc4415e500 0x7fdc440b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3765303264 >> 172.21.15.12:0/3765303264 conn(0x7fdc44062810 msgr2=0x7fdc44062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3765303264 shutdown_connections 2024-09-10T09:23:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.822+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3765303264 wait complete. 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.823+0000 7fdc4bb96640 1 Processor -- start 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.823+0000 7fdc4bb96640 1 -- start start 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4bb96640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc44073cb0 0x7fdc44159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4bb96640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc4415e500 0x7fdc4414d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4bb96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 0x7fdc4415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4bb96640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4406ce30 con 0x7fdc4415e8e0 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4bb96640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4406ccb0 con 0x7fdc4415e500 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4bb96640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdc440d1cf0 con 0x7fdc44073cb0 2024-09-10T09:23:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 0x7fdc4415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 0x7fdc4415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39522/0 (socket says 172.21.15.12:39522) 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 -- 172.21.15.12:0/3532764604 learned_addr learned my addr 172.21.15.12:0/3532764604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc49932640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc44073cb0 0x7fdc44159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc49131640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc4415e500 0x7fdc4414d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 -- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc44073cb0 msgr2=0x7fdc44159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc44073cb0 0x7fdc44159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 -- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc4415e500 msgr2=0x7fdc4414d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc4415e500 0x7fdc4414d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.824+0000 7fdc4a133640 1 -- 172.21.15.12:0/3532764604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4414da50 con 0x7fdc4415e8e0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.825+0000 7fdc4a133640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 0x7fdc4415c230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c02ac00 tx=0x7fdc3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.825+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c03f020 con 0x7fdc4415e8e0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.825+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c037040 con 0x7fdc4415e8e0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.825+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4415d040 con 0x7fdc4415e8e0 2024-09-10T09:23:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.825+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c036070 con 0x7fdc4415e8e0 2024-09-10T09:23:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.825+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4415cd60 con 0x7fdc4415e8e0 2024-09-10T09:23:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.826+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc440b4460 con 0x7fdc4415e8e0 2024-09-10T09:23:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.826+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fdc3c042020 con 0x7fdc4415e8e0 2024-09-10T09:23:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.827+0000 7fdc3a7fc640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fdc2806bfe0 0x7fdc2806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.827+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fdc3c0ab4a0 con 0x7fdc4415e8e0 2024-09-10T09:23:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.827+0000 7fdc49932640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fdc2806bfe0 0x7fdc2806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.828+0000 7fdc49932640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fdc2806bfe0 0x7fdc2806e4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009ac0 tx=0x7fdc40009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:44.831+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc3c049020 con 0x7fdc4415e8e0 2024-09-10T09:23:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.007+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdc44069160 con 0x7fdc2806bfe0 2024-09-10T09:23:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.008+0000 7fdc3a7fc640 1 -- 172.21.15.12:0/3532764604 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc44069160 con 0x7fdc2806bfe0 2024-09-10T09:23:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T09:23:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fdc2806bfe0 msgr2=0x7fdc2806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fdc2806bfe0 0x7fdc2806e4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009ac0 tx=0x7fdc40009190 comp rx=0 tx=0).stop 2024-09-10T09:23:45.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 msgr2=0x7fdc4415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 0x7fdc4415c230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c02ac00 tx=0x7fdc3c004a40 comp rx=0 tx=0).stop 2024-09-10T09:23:45.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 shutdown_connections 2024-09-10T09:23:45.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fdc2806bfe0 0x7fdc2806e4a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4415e8e0 0x7fdc4415c230 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc4415e500 0x7fdc4414d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 --2- 172.21.15.12:0/3532764604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc44073cb0 0x7fdc44159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 >> 172.21.15.12:0/3532764604 conn(0x7fdc44062810 msgr2=0x7fdc440b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 shutdown_connections 2024-09-10T09:23:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.010+0000 7fdc4bb96640 1 -- 172.21.15.12:0/3532764604 wait complete. 2024-09-10T09:23:45.023 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T09:23:45.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.130+0000 7f95aac65640 1 Processor -- start 2024-09-10T09:23:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.130+0000 7f95aac65640 1 -- start start 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.131+0000 7f95aac65640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.131+0000 7f95aac65640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95a40738f0 0x7f95a40d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.131+0000 7f95aac65640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a40d21b0 con 0x7f95a4070d30 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.131+0000 7f95aac65640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f95a40d2420 con 0x7f95a40738f0 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.131+0000 7f95aac65640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f95a40d2700 con 0x7f95a415a1e0 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a8a01640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a9202640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95a40738f0 0x7f95a40d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a3fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f95a4070d30 0x7f95a40731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:47334/0 (socket says 172.21.15.12:47334) 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a3fff640 1 -- 172.21.15.12:0/3012731882 learned_addr learned my addr 172.21.15.12:0/3012731882 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a37fe640 1 -- 172.21.15.12:0/3012731882 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457470518 0 0) 0x7f95a40d21b0 con 0x7f95a4070d30 2024-09-10T09:23:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a37fe640 1 -- 172.21.15.12:0/3012731882 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f958c003520 con 0x7f95a4070d30 2024-09-10T09:23:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a9202640 1 -- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 msgr2=0x7f95a415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a9202640 1 --2- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a9202640 1 -- 172.21.15.12:0/3012731882 >> v1:172.21.15.100:6789/0 conn(0x7f95a4070d30 legacy=0x7f95a40731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a9202640 1 -- 172.21.15.12:0/3012731882 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a40d29e0 con 0x7f95a40738f0 2024-09-10T09:23:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.132+0000 7f95a8a01640 1 --2- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.133+0000 7f95a9202640 1 --2- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a40738f0 0x7f95a40d0550 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f959c009d90 tx=0x7f959c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d04730b2a2989d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.133+0000 7f95a37fe640 1 -- 172.21.15.12:0/3012731882 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c007740 con 0x7f95a40738f0 2024-09-10T09:23:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.133+0000 7f95a37fe640 1 -- 172.21.15.12:0/3012731882 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c0078e0 con 0x7f95a40738f0 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.133+0000 7f95a37fe640 1 -- 172.21.15.12:0/3012731882 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c007c90 con 0x7f95a40738f0 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 -- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a40738f0 msgr2=0x7f95a40d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 --2- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a40738f0 0x7f95a40d0550 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f959c009d90 tx=0x7f959c02a660 comp rx=0 tx=0).stop 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 -- 172.21.15.12:0/3012731882 shutdown_connections 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 --2- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a40738f0 0x7f95a40d0550 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 --2- 172.21.15.12:0/3012731882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 -- 172.21.15.12:0/3012731882 >> 172.21.15.12:0/3012731882 conn(0x7f95a406f370 msgr2=0x7f95a406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 -- 172.21.15.12:0/3012731882 shutdown_connections 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.134+0000 7f95aac65640 1 -- 172.21.15.12:0/3012731882 wait complete. 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.135+0000 7f95aac65640 1 Processor -- start 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.135+0000 7f95aac65640 1 -- start start 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95aac65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a4070d30 0x7f95a4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95aac65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95a40738f0 0x7f95a40c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95aac65640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a4158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95aac65640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f95a4071170 con 0x7f95a40738f0 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95aac65640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f95a415a5c0 con 0x7f95a4070d30 2024-09-10T09:23:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95aac65640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f95a40b73f0 con 0x7f95a415a1e0 2024-09-10T09:23:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95a40738f0 0x7f95a40c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95a40738f0 0x7f95a40c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39530/0 (socket says 172.21.15.12:39530) 2024-09-10T09:23:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 -- 172.21.15.12:0/2306827544 learned_addr learned my addr 172.21.15.12:0/2306827544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a9202640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a4158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a8a01640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a4070d30 0x7f95a4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 -- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 msgr2=0x7f95a4158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95a415a1e0 0x7f95a4158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 -- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a4070d30 msgr2=0x7f95a4151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a4070d30 0x7f95a4151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a3fff640 1 -- 172.21.15.12:0/2306827544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a40b76d0 con 0x7f95a40738f0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.136+0000 7f95a8a01640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95a4070d30 0x7f95a4151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.137+0000 7f95a3fff640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95a40738f0 0x7f95a40c7610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f959800c460 tx=0x7f959800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.137+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598017070 con 0x7f95a40738f0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.137+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9598005ce0 con 0x7f95a40738f0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.137+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a40aea60 con 0x7f95a40738f0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.137+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598007290 con 0x7f95a40738f0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.137+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a41519c0 con 0x7f95a40738f0 2024-09-10T09:23:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.138+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95a40b7910 con 0x7f95a40738f0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.138+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f959801a070 con 0x7f95a40738f0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a17fa640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f959006bfe0 0x7f959006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f959808a210 con 0x7f95a40738f0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a17fa640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7f9590071ea0 0x7f95900742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 --> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9598014ec0 con 0x7f9590071ea0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9598091050 con 0x7f95a40738f0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a8a01640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f959006bfe0 0x7f959006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.139+0000 7f95a9202640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7f9590071ea0 0x7f95900742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.140+0000 7f95a9202640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7f9590071ea0 0x7f95900742c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.140+0000 7f95a8a01640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f959006bfe0 0x7f959006e4a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9594009af0 tx=0x7f9594008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.140+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== osd.3 v2:172.21.15.12:6824/2116037928 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9598014ec0 con 0x7f9590071ea0 2024-09-10T09:23:45.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 --> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f95a415d8f0 con 0x7f9590071ea0 2024-09-10T09:23:45.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95a17fa640 1 -- 172.21.15.12:0/2306827544 <== osd.3 v2:172.21.15.12:6824/2116037928 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f95a415d8f0 con 0x7f9590071ea0 2024-09-10T09:23:45.154 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:45.154 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7f9590071ea0 msgr2=0x7f95900742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:6824/2116037928,v1:172.21.15.12:6825/2116037928] conn(0x7f9590071ea0 0x7f95900742c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f959006bfe0 msgr2=0x7f959006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f959006bfe0 0x7f959006e4a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9594009af0 tx=0x7f9594008040 comp rx=0 tx=0).stop 2024-09-10T09:23:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95a40738f0 msgr2=0x7f95a40c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.153+0000 7f95aac65640 1 --2- 172.21.15.12:0/2306827544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95a40738f0 0x7f95a40c7610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f959800c460 tx=0x7f959800c920 comp rx=0 tx=0).stop 2024-09-10T09:23:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.154+0000 7f95a9202640 1 -- 172.21.15.12:0/2306827544 reap_dead start 2024-09-10T09:23:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.154+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 shutdown_connections 2024-09-10T09:23:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.154+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 >> 172.21.15.12:0/2306827544 conn(0x7f95a406f370 msgr2=0x7f95a406e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.154+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 shutdown_connections 2024-09-10T09:23:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.154+0000 7f95aac65640 1 -- 172.21.15.12:0/2306827544 wait complete. 2024-09-10T09:23:45.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T09:23:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 Processor -- start 2024-09-10T09:23:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 -- start start 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f579c15e7b0 0x7f579c071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c0b5600 0x7f579c073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c071880 con 0x7f579c073ff0 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f579c06e680 con 0x7f579c15e7b0 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.268+0000 7f57a1931640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f579c06e8d0 con 0x7f579c0b5600 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f579c073ff0 0x7f579c06ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58452/0 (socket says 172.21.15.12:58452) 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579b7fe640 1 -- 172.21.15.12:0/1786790272 learned_addr learned my addr 172.21.15.12:0/1786790272 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579affd640 1 --2- 172.21.15.12:0/1786790272 >> v2:172.21.15.100:3300/0 conn(0x7f579c15e7b0 0x7f579c071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579a7fc640 1 --2- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c0b5600 0x7f579c073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f5799ffb640 1 -- 172.21.15.12:0/1786790272 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044243325 0 0) 0x7f5794001490 con 0x7f579c073ff0 2024-09-10T09:23:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f5799ffb640 1 -- 172.21.15.12:0/1786790272 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5784003520 con 0x7f579c073ff0 2024-09-10T09:23:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f5799ffb640 1 -- 172.21.15.12:0/1786790272 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1899458657 0 0) 0x7f5784003520 con 0x7f579c073ff0 2024-09-10T09:23:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579affd640 1 -- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c0b5600 msgr2=0x7f579c073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579affd640 1 --2- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c0b5600 0x7f579c073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579affd640 1 -- 172.21.15.12:0/1786790272 >> v1:172.21.15.12:6789/0 conn(0x7f579c073ff0 legacy=0x7f579c06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.269+0000 7f579affd640 1 -- 172.21.15.12:0/1786790272 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c06ebb0 con 0x7f579c15e7b0 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.270+0000 7f579affd640 1 --2- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c15e7b0 0x7f579c071340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f578c0097a0 tx=0x7f578c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d336a327834bc90f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.270+0000 7f5799ffb640 1 -- 172.21.15.12:0/1786790272 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c037070 con 0x7f579c15e7b0 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.270+0000 7f5799ffb640 1 -- 172.21.15.12:0/1786790272 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c02ab10 con 0x7f579c15e7b0 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.270+0000 7f5799ffb640 1 -- 172.21.15.12:0/1786790272 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794001bc0 con 0x7f579c15e7b0 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 -- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c15e7b0 msgr2=0x7f579c071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 --2- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c15e7b0 0x7f579c071340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f578c0097a0 tx=0x7f578c02a080 comp rx=0 tx=0).stop 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 -- 172.21.15.12:0/1786790272 shutdown_connections 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 --2- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c0b5600 0x7f579c073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 --2- 172.21.15.12:0/1786790272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c15e7b0 0x7f579c071340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 -- 172.21.15.12:0/1786790272 >> 172.21.15.12:0/1786790272 conn(0x7f579c0b4300 msgr2=0x7f579c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 -- 172.21.15.12:0/1786790272 shutdown_connections 2024-09-10T09:23:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.271+0000 7f57a1931640 1 -- 172.21.15.12:0/1786790272 wait complete. 2024-09-10T09:23:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.272+0000 7f57a1931640 1 Processor -- start 2024-09-10T09:23:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.272+0000 7f57a1931640 1 -- start start 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f57a1931640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 0x7f579c14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f57a1931640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c15e7b0 0x7f579c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f57a1931640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c158050 0x7f579c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f57a1931640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f579c06d3c0 con 0x7f579c0b5600 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f57a1931640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f579c073590 con 0x7f579c158050 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f57a1931640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f579c06d540 con 0x7f579c15e7b0 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 0x7f579c14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 0x7f579c14b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39542/0 (socket says 172.21.15.12:39542) 2024-09-10T09:23:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 -- 172.21.15.12:0/3464874323 learned_addr learned my addr 172.21.15.12:0/3464874323 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579a7fc640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c15e7b0 0x7f579c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579b7fe640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c158050 0x7f579c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 -- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c15e7b0 msgr2=0x7f579c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c15e7b0 0x7f579c15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 -- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c158050 msgr2=0x7f579c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c158050 0x7f579c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.273+0000 7f579affd640 1 -- 172.21.15.12:0/3464874323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c14b5e0 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.274+0000 7f579affd640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 0x7f579c14b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f578c035040 tx=0x7f578c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.274+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c041020 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.274+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c03d620 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.274+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c15b440 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.274+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c037040 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.274+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c15ba00 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.275+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f579c073ab0 con 0x7f579c0b5600 2024-09-10T09:23:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.275+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f578c044020 con 0x7f579c0b5600 2024-09-10T09:23:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.276+0000 7f5783fff640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f578806bfe0 0x7f578806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.276+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f578c0ab290 con 0x7f579c0b5600 2024-09-10T09:23:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.276+0000 7f579a7fc640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f578806bfe0 0x7f578806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.277+0000 7f579a7fc640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f578806bfe0 0x7f578806e4a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f579c15ce90 tx=0x7f5790009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.280+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f578c04b030 con 0x7f579c0b5600 2024-09-10T09:23:45.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.457+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f579c0b1a90 con 0x7f578806bfe0 2024-09-10T09:23:45.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.458+0000 7f5783fff640 1 -- 172.21.15.12:0/3464874323 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f579c0b1a90 con 0x7f578806bfe0 2024-09-10T09:23:45.459 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f578806bfe0 msgr2=0x7f578806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f578806bfe0 0x7f578806e4a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f579c15ce90 tx=0x7f5790009190 comp rx=0 tx=0).stop 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 msgr2=0x7f579c14b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 0x7f579c14b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f578c035040 tx=0x7f578c0046c0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 shutdown_connections 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f578806bfe0 0x7f578806e4a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c158050 0x7f579c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f579c15e7b0 0x7f579c15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 --2- 172.21.15.12:0/3464874323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f579c0b5600 0x7f579c14b0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 >> 172.21.15.12:0/3464874323 conn(0x7f579c0b4300 msgr2=0x7f579c15f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 shutdown_connections 2024-09-10T09:23:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.460+0000 7f57a1931640 1 -- 172.21.15.12:0/3464874323 wait complete. 2024-09-10T09:23:45.472 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T09:23:45.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.578+0000 7fa4d305e640 1 Processor -- start 2024-09-10T09:23:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.578+0000 7fa4d305e640 1 -- start start 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d305e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4cc0b61e0 0x7fa4cc0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d305e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4cc0d3990 0x7fa4cc162ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d305e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4cc0b6b00 con 0x7fa4cc0b3b00 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d305e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa4cc0d24f0 con 0x7fa4cc0d3990 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d305e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa4cc0d20e0 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d15fb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4cc0d3990 0x7fa4cc162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d15fb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4cc0d3990 0x7fa4cc162ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39558/0 (socket says 172.21.15.12:39558) 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.579+0000 7fa4d15fb640 1 -- 172.21.15.12:0/1956798754 learned_addr learned my addr 172.21.15.12:0/1956798754 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.580+0000 7fa4d0dfa640 1 --2- 172.21.15.12:0/1956798754 >> v2:172.21.15.100:3300/0 conn(0x7fa4cc0b61e0 0x7fa4cc0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.580+0000 7fa4d15fb640 1 -- 172.21.15.12:0/1956798754 >> v2:172.21.15.100:3300/0 conn(0x7fa4cc0b61e0 msgr2=0x7fa4cc0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.580+0000 7fa4d15fb640 1 --2- 172.21.15.12:0/1956798754 >> v2:172.21.15.100:3300/0 conn(0x7fa4cc0b61e0 0x7fa4cc0b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.580+0000 7fa4d15fb640 1 -- 172.21.15.12:0/1956798754 >> v1:172.21.15.100:6789/0 conn(0x7fa4cc0b3b00 legacy=0x7fa4cc1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.580+0000 7fa4d15fb640 1 -- 172.21.15.12:0/1956798754 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc0cfa70 con 0x7fa4cc0d3990 2024-09-10T09:23:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.580+0000 7fa4d15fb640 1 --2- 172.21.15.12:0/1956798754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0d3990 0x7fa4cc162ce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc06be00 tx=0x7fa4c402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9e2a4ad35fae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4cb7fe640 1 -- 172.21.15.12:0/1956798754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4036070 con 0x7fa4cc0d3990 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4cb7fe640 1 -- 172.21.15.12:0/1956798754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c4031600 con 0x7fa4cc0d3990 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4cb7fe640 1 -- 172.21.15.12:0/1956798754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40319d0 con 0x7fa4cc0d3990 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 -- 172.21.15.12:0/1956798754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0d3990 msgr2=0x7fa4cc162ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 --2- 172.21.15.12:0/1956798754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0d3990 0x7fa4cc162ce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc06be00 tx=0x7fa4c402a5d0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 -- 172.21.15.12:0/1956798754 shutdown_connections 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 --2- 172.21.15.12:0/1956798754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0d3990 0x7fa4cc162ce0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 --2- 172.21.15.12:0/1956798754 >> v2:172.21.15.100:3300/0 conn(0x7fa4cc0b61e0 0x7fa4cc0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 -- 172.21.15.12:0/1956798754 >> 172.21.15.12:0/1956798754 conn(0x7fa4cc0d11e0 msgr2=0x7fa4cc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 -- 172.21.15.12:0/1956798754 shutdown_connections 2024-09-10T09:23:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.581+0000 7fa4d305e640 1 -- 172.21.15.12:0/1956798754 wait complete. 2024-09-10T09:23:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 Processor -- start 2024-09-10T09:23:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 -- start start 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4cc0b3b00 0x7fa4cc14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0b61e0 0x7fa4cc1ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4cc0d3990 0x7fa4cc1e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc15edc0 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0d0030 con 0x7fa4cc0d3990 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.583+0000 7fa4d305e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc14d700 con 0x7fa4cc0b3b00 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0b61e0 0x7fa4cc1ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0b61e0 0x7fa4cc1ea420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39564/0 (socket says 172.21.15.12:39564) 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 -- 172.21.15.12:0/3645938277 learned_addr learned my addr 172.21.15.12:0/3645938277 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4d15fb640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4cc0d3990 0x7fa4cc1e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4d0dfa640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4cc0b3b00 0x7fa4cc14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 -- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4cc0b3b00 msgr2=0x7fa4cc14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4cc0b3b00 0x7fa4cc14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 -- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4cc0d3990 msgr2=0x7fa4cc1e85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4cc0d3990 0x7fa4cc1e85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 -- 172.21.15.12:0/3645938277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc14ab10 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4cbfff640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0b61e0 0x7fa4cc1ea420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b3e0 tx=0x7fa4c000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0015020 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0011850 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc14adf0 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0011c40 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.584+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc14b3b0 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.585+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4cc0d1d00 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.586+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fa4c0018020 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.586+0000 7fa4c97fa640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4b806c010 0x7fa4b806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.586+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fa4c008ad90 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4c97fa640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7fa4b8071ed0 0x7fa4b80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 --> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4b80749a0 con 0x7fa4b8071ed0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa4c008d470 con 0x7fa4cc0b61e0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4d0dfa640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4b806c010 0x7fa4b806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4d15fb640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7fa4b8071ed0 0x7fa4b80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4d0dfa640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4b806c010 0x7fa4b806e4d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc006fd0 tx=0x7fa4bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.587+0000 7fa4d15fb640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7fa4b8071ed0 0x7fa4b80742f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.588+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== osd.4 v2:172.21.15.100:6816/3211705705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4b80749a0 con 0x7fa4b8071ed0 2024-09-10T09:23:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.601+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 --> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa4cc0ba6e0 con 0x7fa4b8071ed0 2024-09-10T09:23:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.601+0000 7fa4c97fa640 1 -- 172.21.15.12:0/3645938277 <== osd.4 v2:172.21.15.100:6816/3211705705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa4cc0ba6e0 con 0x7fa4b8071ed0 2024-09-10T09:23:45.602 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:45.603 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7fa4b8071ed0 msgr2=0x7fa4b80742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6816/3211705705,v1:172.21.15.100:6817/3211705705] conn(0x7fa4b8071ed0 0x7fa4b80742f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4b806c010 msgr2=0x7fa4b806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa4b806c010 0x7fa4b806e4d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc006fd0 tx=0x7fa4bc008040 comp rx=0 tx=0).stop 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0b61e0 msgr2=0x7fa4cc1ea420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 --2- 172.21.15.12:0/3645938277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4cc0b61e0 0x7fa4cc1ea420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b3e0 tx=0x7fa4c000b8a0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d15fb640 1 -- 172.21.15.12:0/3645938277 reap_dead start 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 shutdown_connections 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 >> 172.21.15.12:0/3645938277 conn(0x7fa4cc0d11e0 msgr2=0x7fa4cc1610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 shutdown_connections 2024-09-10T09:23:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.602+0000 7fa4d305e640 1 -- 172.21.15.12:0/3645938277 wait complete. 2024-09-10T09:23:45.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T09:23:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.716+0000 7fcce7791640 1 Processor -- start 2024-09-10T09:23:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.716+0000 7fcce7791640 1 -- start start 2024-09-10T09:23:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce7791640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce7791640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcce00cef90 0x7fcce00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce7791640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce00b7170 con 0x7fcce015e940 2024-09-10T09:23:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce7791640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcce00b7aa0 con 0x7fcce00cef90 2024-09-10T09:23:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce7791640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00d3660 con 0x7fcce015ed20 2024-09-10T09:23:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce5d2e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcce00cef90 0x7fcce00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce4d2c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce552d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcce015e940 0x7fcce00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:47360/0 (socket says 172.21.15.12:47360) 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce552d640 1 -- 172.21.15.12:0/1830175334 learned_addr learned my addr 172.21.15.12:0/1830175334 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.717+0000 7fcce5d2e640 1 -- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 msgr2=0x7fcce00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.718+0000 7fcce5d2e640 1 --2- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.718+0000 7fcce5d2e640 1 -- 172.21.15.12:0/1830175334 >> v1:172.21.15.100:6789/0 conn(0x7fcce015e940 legacy=0x7fcce00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.718+0000 7fcce5d2e640 1 -- 172.21.15.12:0/1830175334 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce00d3940 con 0x7fcce00cef90 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.718+0000 7fccd7fff640 1 -- 172.21.15.12:0/1830175334 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324574555 0 0) 0x7fccdc001110 con 0x7fcce015e940 2024-09-10T09:23:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.718+0000 7fcce4d2c640 1 --2- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.718+0000 7fcce5d2e640 1 --2- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce00cef90 0x7fcce00b3760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009d90 tx=0x7fccd802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf31325d11018ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fccd7fff640 1 -- 172.21.15.12:0/1830175334 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8007740 con 0x7fcce00cef90 2024-09-10T09:23:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fccd7fff640 1 -- 172.21.15.12:0/1830175334 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd80078e0 con 0x7fcce00cef90 2024-09-10T09:23:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fccd7fff640 1 -- 172.21.15.12:0/1830175334 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8007cb0 con 0x7fcce00cef90 2024-09-10T09:23:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 -- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce00cef90 msgr2=0x7fcce00b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 --2- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce00cef90 0x7fcce00b3760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009d90 tx=0x7fccd802a6f0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 -- 172.21.15.12:0/1830175334 shutdown_connections 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 --2- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce00cef90 0x7fcce00b3760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 --2- 172.21.15.12:0/1830175334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 -- 172.21.15.12:0/1830175334 >> 172.21.15.12:0/1830175334 conn(0x7fcce00b6240 msgr2=0x7fcce00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 -- 172.21.15.12:0/1830175334 shutdown_connections 2024-09-10T09:23:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.719+0000 7fcce7791640 1 -- 172.21.15.12:0/1830175334 wait complete. 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.720+0000 7fcce7791640 1 Processor -- start 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.720+0000 7fcce7791640 1 -- start start 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce7791640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 0x7fcce01f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce7791640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce015e940 0x7fcce00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce7791640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce7791640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d3310 con 0x7fcce00cef90 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce7791640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00d3f00 con 0x7fcce015e940 2024-09-10T09:23:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce7791640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00d1ef0 con 0x7fcce015ed20 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce552d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 0x7fcce01f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce552d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 0x7fcce01f3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39580/0 (socket says 172.21.15.12:39580) 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce552d640 1 -- 172.21.15.12:0/2978217556 learned_addr learned my addr 172.21.15.12:0/2978217556 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce5d2e640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.721+0000 7fcce4d2c640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce015e940 0x7fcce00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce552d640 1 -- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 msgr2=0x7fcce00ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce552d640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce552d640 1 -- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce015e940 msgr2=0x7fcce00cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce552d640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce015e940 0x7fcce00cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce552d640 1 -- 172.21.15.12:0/2978217556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce0145e50 con 0x7fcce00cef90 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce552d640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 0x7fcce01f3fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c780 tx=0x7fccdc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc018070 con 0x7fcce00cef90 2024-09-10T09:23:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccdc0072d0 con 0x7fcce00cef90 2024-09-10T09:23:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce0146130 con 0x7fcce00cef90 2024-09-10T09:23:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0047e0 con 0x7fcce00cef90 2024-09-10T09:23:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.722+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce01466f0 con 0x7fcce00cef90 2024-09-10T09:23:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.723+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce00d1060 con 0x7fcce00cef90 2024-09-10T09:23:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.723+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fccdc01b070 con 0x7fcce00cef90 2024-09-10T09:23:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.724+0000 7fccd5ffb640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fccc406bfe0 0x7fccc406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.724+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fccdc08a210 con 0x7fcce00cef90 2024-09-10T09:23:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.724+0000 7fcce4d2c640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fccc406bfe0 0x7fccc406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.724+0000 7fcce4d2c640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fccc406bfe0 0x7fccc406e4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcce014c4c0 tx=0x7fccd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:45.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.728+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcce00b7170 con 0x7fcce00cef90 2024-09-10T09:23:45.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.904+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcce00b8390 con 0x7fccc406bfe0 2024-09-10T09:23:45.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.905+0000 7fccd5ffb640 1 -- 172.21.15.12:0/2978217556 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcce00b8390 con 0x7fccc406bfe0 2024-09-10T09:23:45.905 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fccc406bfe0 msgr2=0x7fccc406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fccc406bfe0 0x7fccc406e4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcce014c4c0 tx=0x7fccd0008040 comp rx=0 tx=0).stop 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 msgr2=0x7fcce01f3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 0x7fcce01f3fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c780 tx=0x7fccdc00cc40 comp rx=0 tx=0).stop 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 shutdown_connections 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fccc406bfe0 0x7fccc406e4a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcce015ed20 0x7fcce00ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce015e940 0x7fcce00cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 --2- 172.21.15.12:0/2978217556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcce00cef90 0x7fcce01f3fc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 >> 172.21.15.12:0/2978217556 conn(0x7fcce00b6240 msgr2=0x7fcce00b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 shutdown_connections 2024-09-10T09:23:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:45.907+0000 7fcce7791640 1 -- 172.21.15.12:0/2978217556 wait complete. 2024-09-10T09:23:45.918 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T09:23:45.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.024+0000 7ffb29781640 1 Processor -- start 2024-09-10T09:23:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.024+0000 7ffb29781640 1 -- start start 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb29781640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 0x7ffb241674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb29781640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240d21b0 con 0x7ffb2415a1e0 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb29781640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240d2420 con 0x7ffb2415d8f0 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb29781640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2415dd60 con 0x7ffb240738f0 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb22ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffb2415a1e0 0x7ffb24070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58456/0 (socket says 172.21.15.12:58456) 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb22ffd640 1 -- 172.21.15.12:0/1709695502 learned_addr learned my addr 172.21.15.12:0/1709695502 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb237fe640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 0x7ffb241674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723001084 0 0) 0x7ffb240d21b0 con 0x7ffb2415a1e0 2024-09-10T09:23:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb10003520 con 0x7ffb2415a1e0 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802234147 0 0) 0x7ffb240d2420 con 0x7ffb2415d8f0 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb240d21b0 con 0x7ffb2415d8f0 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1806008942 0 0) 0x7ffb10003520 con 0x7ffb2415a1e0 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 msgr2=0x7ffb241674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 0x7ffb241674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 >> v1:172.21.15.100:6789/0 conn(0x7ffb2415d8f0 legacy=0x7ffb240731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb240d2700 con 0x7ffb2415a1e0 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7ffb14001670 con 0x7ffb2415a1e0 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 >> v1:172.21.15.12:6789/0 conn(0x7ffb2415a1e0 legacy=0x7ffb24070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10003b70 0x7ffb10003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 0x7ffb10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10004d40 0x7ffb100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.025+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1000ba70 con 0x7ffb10003b70 2024-09-10T09:23:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1000bc20 con 0x7ffb10004d40 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1000be20 con 0x7ffb240738f0 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10003b70 0x7ffb10003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb1a7fc640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 0x7ffb10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb237fe640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10004d40 0x7ffb100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb22ffd640 1 -- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 msgr2=0x7ffb10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb240738f0 0x7ffb10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb22ffd640 1 -- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10004d40 msgr2=0x7ffb100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10004d40 0x7ffb100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb22ffd640 1 -- 172.21.15.12:0/1709695502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10003520 con 0x7ffb10003b70 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.026+0000 7ffb237fe640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10004d40 0x7ffb100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10003b70 0x7ffb10003f70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c190 tx=0x7ffb10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe637a61f09178f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007cc0 con 0x7ffb10003b70 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14005af0 con 0x7ffb10003b70 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb227fc640 1 -- 172.21.15.12:0/1709695502 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007070 con 0x7ffb10003b70 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb29781640 1 -- 172.21.15.12:0/1709695502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10003b70 msgr2=0x7ffb10003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb29781640 1 --2- 172.21.15.12:0/1709695502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb10003b70 0x7ffb10003f70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c190 tx=0x7ffb10005830 comp rx=0 tx=0).stop 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb237fe640 1 -- 172.21.15.12:0/1709695502 reap_dead start 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb29781640 1 -- 172.21.15.12:0/1709695502 shutdown_connections 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb29781640 1 -- 172.21.15.12:0/1709695502 >> 172.21.15.12:0/1709695502 conn(0x7ffb2406f370 msgr2=0x7ffb2406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb29781640 1 -- 172.21.15.12:0/1709695502 shutdown_connections 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.027+0000 7ffb29781640 1 -- 172.21.15.12:0/1709695502 wait complete. 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.028+0000 7ffb29781640 1 Processor -- start 2024-09-10T09:23:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 -- start start 2024-09-10T09:23:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10003b70 0x7ffb2406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb241f7710 0x7ffb240af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb24148dd0 0x7ffb24149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2415a5c0 con 0x7ffb24148dd0 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb240d2cc0 con 0x7ffb10003b70 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.029+0000 7ffb29781640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2415a740 con 0x7ffb241f7710 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb24148dd0 0x7ffb24149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb24148dd0 0x7ffb24149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39596/0 (socket says 172.21.15.12:39596) 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 -- 172.21.15.12:0/2384731505 learned_addr learned my addr 172.21.15.12:0/2384731505 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10003b70 0x7ffb2406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb1a7fc640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb241f7710 0x7ffb240af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 -- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb241f7710 msgr2=0x7ffb240af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffb241f7710 0x7ffb240af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 -- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10003b70 msgr2=0x7ffb2406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb10003b70 0x7ffb2406ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 -- 172.21.15.12:0/2384731505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2406d4e0 con 0x7ffb24148dd0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb237fe640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb24148dd0 0x7ffb24149250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb24073170 tx=0x7ffb1c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c010e00 con 0x7ffb24148dd0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1c003990 con 0x7ffb24148dd0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2406d7c0 con 0x7ffb24148dd0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c003dc0 con 0x7ffb24148dd0 2024-09-10T09:23:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.030+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2406dd80 con 0x7ffb24148dd0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.031+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb24070d30 con 0x7ffb24148dd0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ffb1c005d10 con 0x7ffb24148dd0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb1bfff640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ffb0406c010 0x7ffb0406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ffb1c08b590 con 0x7ffb24148dd0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb1bfff640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7ffb04071ed0 0x7ffb040742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 --> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb1c01de70 con 0x7ffb04071ed0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ffb0406c010 0x7ffb0406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.032+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb1c092050 con 0x7ffb24148dd0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.033+0000 7ffb1a7fc640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7ffb04071ed0 0x7ffb040742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.033+0000 7ffb22ffd640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ffb0406c010 0x7ffb0406e4d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb14032000 tx=0x7ffb14034040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.033+0000 7ffb1a7fc640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7ffb04071ed0 0x7ffb040742f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.034+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== osd.5 v2:172.21.15.100:6808/1581570554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb1c01de70 con 0x7ffb04071ed0 2024-09-10T09:23:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 --> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb24069160 con 0x7ffb04071ed0 2024-09-10T09:23:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb1bfff640 1 -- 172.21.15.12:0/2384731505 <== osd.5 v2:172.21.15.100:6808/1581570554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb24069160 con 0x7ffb04071ed0 2024-09-10T09:23:46.048 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:46.048 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7ffb04071ed0 msgr2=0x7ffb040742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6808/1581570554,v1:172.21.15.100:6809/1581570554] conn(0x7ffb04071ed0 0x7ffb040742f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ffb0406c010 msgr2=0x7ffb0406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7ffb0406c010 0x7ffb0406e4d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb14032000 tx=0x7ffb14034040 comp rx=0 tx=0).stop 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb24148dd0 msgr2=0x7ffb24149250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 --2- 172.21.15.12:0/2384731505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb24148dd0 0x7ffb24149250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb24073170 tx=0x7ffb1c010590 comp rx=0 tx=0).stop 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb237fe640 1 -- 172.21.15.12:0/2384731505 reap_dead start 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 shutdown_connections 2024-09-10T09:23:46.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.047+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 >> 172.21.15.12:0/2384731505 conn(0x7ffb2406f370 msgr2=0x7ffb240d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.048+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 shutdown_connections 2024-09-10T09:23:46.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.048+0000 7ffb29781640 1 -- 172.21.15.12:0/2384731505 wait complete. 2024-09-10T09:23:46.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T09:23:46.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.161+0000 7fe11c54b640 1 Processor -- start 2024-09-10T09:23:46.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.161+0000 7fe11c54b640 1 -- start start 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe11c54b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe1140b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe11c54b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140b7170 con 0x7fe1140cef90 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe11c54b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140b7aa0 con 0x7fe11415e940 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe11c54b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe1140d3660 con 0x7fe11415ed20 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe11aae8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe1140cef90 0x7fe1140b3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58468/0 (socket says 172.21.15.12:58468) 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe11aae8640 1 -- 172.21.15.12:0/1074748849 learned_addr learned my addr 172.21.15.12:0/1074748849 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe119ae6640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe1140b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140439362 0 0) 0x7fe10c001490 con 0x7fe1140cef90 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.162+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe100003520 con 0x7fe1140cef90 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3724485677 0 0) 0x7fe100003520 con 0x7fe1140cef90 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 msgr2=0x7fe1140b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe1140b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 >> v1:172.21.15.100:6789/0 conn(0x7fe11415e940 legacy=0x7fe1140d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140d3940 con 0x7fe1140cef90 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7fe10c001bc0 con 0x7fe1140cef90 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe119ae6640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe1140b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 >> v1:172.21.15.12:6789/0 conn(0x7fe1140cef90 legacy=0x7fe1140b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1000039e0 0x7fe100003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe100004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe100004d40 0x7fe1000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1140d3660 con 0x7fe1000039e0 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe10000b9c0 con 0x7fe100004d40 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe10000bbc0 con 0x7fe11415ed20 2024-09-10T09:23:46.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1000039e0 0x7fe100003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11aae8640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe100004d40 0x7fe1000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe119ae6640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe100004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11a2e7640 1 -- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 msgr2=0x7fe100004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe11415ed20 0x7fe100004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11a2e7640 1 -- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe100004d40 msgr2=0x7fe1000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe100004d40 0x7fe1000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.163+0000 7fe11a2e7640 1 -- 172.21.15.12:0/1074748849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe100003520 con 0x7fe1000039e0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.164+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1000039e0 0x7fe100003dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe110001910 tx=0x7fe100005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7350385b6209e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.164+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110037070 con 0x7fe1000039e0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.164+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe11002ac60 con 0x7fe1000039e0 2024-09-10T09:23:46.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.164+0000 7fe1192e5640 1 -- 172.21.15.12:0/1074748849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100014e0 con 0x7fe1000039e0 2024-09-10T09:23:46.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11c54b640 1 -- 172.21.15.12:0/1074748849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1000039e0 msgr2=0x7fe100003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11c54b640 1 --2- 172.21.15.12:0/1074748849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1000039e0 0x7fe100003dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe110001910 tx=0x7fe100005830 comp rx=0 tx=0).stop 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11aae8640 1 -- 172.21.15.12:0/1074748849 reap_dead start 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11c54b640 1 -- 172.21.15.12:0/1074748849 shutdown_connections 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11c54b640 1 -- 172.21.15.12:0/1074748849 >> 172.21.15.12:0/1074748849 conn(0x7fe1140b6240 msgr2=0x7fe1140b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11c54b640 1 -- 172.21.15.12:0/1074748849 shutdown_connections 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.165+0000 7fe11c54b640 1 -- 172.21.15.12:0/1074748849 wait complete. 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.166+0000 7fe11c54b640 1 Processor -- start 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.166+0000 7fe11c54b640 1 -- start start 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11c54b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1000039e0 0x7fe1140c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11c54b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 0x7fe11415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11c54b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1141597b0 0x7fe1141613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11c54b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1140d3310 con 0x7fe1141579f0 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11c54b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1140d3f00 con 0x7fe1000039e0 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11c54b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe1140d1ef0 con 0x7fe1141597b0 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 0x7fe11415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 0x7fe11415b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39612/0 (socket says 172.21.15.12:39612) 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 -- 172.21.15.12:0/3852057775 learned_addr learned my addr 172.21.15.12:0/3852057775 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1000039e0 0x7fe1140c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11aae8640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1141597b0 0x7fe1141613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 -- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1141597b0 msgr2=0x7fe1141613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1141597b0 0x7fe1141613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 -- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1000039e0 msgr2=0x7fe1140c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1000039e0 0x7fe1140c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 -- 172.21.15.12:0/3852057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140cac20 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe11aae8640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1141597b0 0x7fe1141613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe119ae6640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 0x7fe11415b1d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe1040119d0 tx=0x7fe104011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.167+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10400faf0 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.168+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10400fc90 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.168+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104004030 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.168+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1140caf00 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.168+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1140cb4c0 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.168+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1140ca970 con 0x7fe1141579f0 2024-09-10T09:23:46.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.169+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe104012040 con 0x7fe1141579f0 2024-09-10T09:23:46.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.169+0000 7fe10affd640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0f806c010 0x7fe0f806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.170+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe10408b1a0 con 0x7fe1141579f0 2024-09-10T09:23:46.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.170+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0f806c010 0x7fe0f806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.170+0000 7fe11a2e7640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0f806c010 0x7fe0f806e4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe110034000 tx=0x7fe11002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.174+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe104019070 con 0x7fe1141579f0 2024-09-10T09:23:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.350+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe1140d1060 con 0x7fe0f806c010 2024-09-10T09:23:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.351+0000 7fe10affd640 1 -- 172.21.15.12:0/3852057775 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe1140d1060 con 0x7fe0f806c010 2024-09-10T09:23:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T09:23:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0f806c010 msgr2=0x7fe0f806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0f806c010 0x7fe0f806e4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe110034000 tx=0x7fe11002e000 comp rx=0 tx=0).stop 2024-09-10T09:23:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 msgr2=0x7fe11415b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 0x7fe11415b1d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe1040119d0 tx=0x7fe104011e90 comp rx=0 tx=0).stop 2024-09-10T09:23:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 shutdown_connections 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fe0f806c010 0x7fe0f806e4d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1141597b0 0x7fe1141613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1141579f0 0x7fe11415b1d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 --2- 172.21.15.12:0/3852057775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1000039e0 0x7fe1140c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 >> 172.21.15.12:0/3852057775 conn(0x7fe1140b6240 msgr2=0x7fe11415ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 shutdown_connections 2024-09-10T09:23:46.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.353+0000 7fe11c54b640 1 -- 172.21.15.12:0/3852057775 wait complete. 2024-09-10T09:23:46.364 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T09:23:46.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.472+0000 7fae7dd4b640 1 Processor -- start 2024-09-10T09:23:46.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.472+0000 7fae7dd4b640 1 -- start start 2024-09-10T09:23:46.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.472+0000 7fae7dd4b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae780b61e0 0x7fae780b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.472+0000 7fae7dd4b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae781633f0 con 0x7fae780d3990 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae7dd4b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780b6b00 con 0x7fae780b3b00 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae7dd4b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fae780d24f0 con 0x7fae780b61e0 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae777fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae780b61e0 0x7fae780b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae77fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae780d3990 0x7fae78162ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58474/0 (socket says 172.21.15.12:58474) 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae77fff640 1 -- 172.21.15.12:0/854367673 learned_addr learned my addr 172.21.15.12:0/854367673 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae777fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae780b61e0 0x7fae780b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39620/0 (socket says 172.21.15.12:39620) 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae777fe640 1 -- 172.21.15.12:0/854367673 >> v1:172.21.15.100:6789/0 conn(0x7fae780b3b00 legacy=0x7fae781625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae777fe640 1 -- 172.21.15.12:0/854367673 >> v1:172.21.15.12:6789/0 conn(0x7fae780d3990 legacy=0x7fae78162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.473+0000 7fae777fe640 1 -- 172.21.15.12:0/854367673 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780d20e0 con 0x7fae780b61e0 2024-09-10T09:23:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.474+0000 7fae777fe640 1 --2- 172.21.15.12:0/854367673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae780b65c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fae680097a0 tx=0x7fae6802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a341b1abcf193e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.474+0000 7fae76ffd640 1 -- 172.21.15.12:0/854367673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68037070 con 0x7fae780b61e0 2024-09-10T09:23:46.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.474+0000 7fae76ffd640 1 -- 172.21.15.12:0/854367673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6802ae50 con 0x7fae780b61e0 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.474+0000 7fae76ffd640 1 -- 172.21.15.12:0/854367673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68032660 con 0x7fae780b61e0 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 -- 172.21.15.12:0/854367673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 msgr2=0x7fae780b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 --2- 172.21.15.12:0/854367673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae780b65c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fae680097a0 tx=0x7fae6802a100 comp rx=0 tx=0).stop 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 -- 172.21.15.12:0/854367673 shutdown_connections 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 --2- 172.21.15.12:0/854367673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae780b65c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 -- 172.21.15.12:0/854367673 >> 172.21.15.12:0/854367673 conn(0x7fae780d11e0 msgr2=0x7fae780d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 -- 172.21.15.12:0/854367673 shutdown_connections 2024-09-10T09:23:46.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.475+0000 7fae7dd4b640 1 -- 172.21.15.12:0/854367673 wait complete. 2024-09-10T09:23:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.476+0000 7fae7dd4b640 1 Processor -- start 2024-09-10T09:23:46.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.476+0000 7fae7dd4b640 1 -- start start 2024-09-10T09:23:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae7dd4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae780b3b00 0x7fae780ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae7dd4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae7815d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae7dd4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae780d3990 0x7fae781e9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae7dd4b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae780d0030 con 0x7fae780b61e0 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae7dd4b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae780cfd50 con 0x7fae780b3b00 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae7dd4b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fae7815edc0 con 0x7fae780d3990 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae7815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae7815d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39636/0 (socket says 172.21.15.12:39636) 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 -- 172.21.15.12:0/15712292 learned_addr learned my addr 172.21.15.12:0/15712292 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae777fe640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae780b3b00 0x7fae780ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae77fff640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae780d3990 0x7fae781e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 -- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae780d3990 msgr2=0x7fae781e9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae780d3990 0x7fae781e9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 -- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae780b3b00 msgr2=0x7fae780ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae780b3b00 0x7fae780ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 -- 172.21.15.12:0/15712292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae781e99d0 con 0x7fae780b61e0 2024-09-10T09:23:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.477+0000 7fae6effd640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae7815d840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c3f0 tx=0x7fae6000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.478+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae600052d0 con 0x7fae780b61e0 2024-09-10T09:23:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.478+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae60005490 con 0x7fae780b61e0 2024-09-10T09:23:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.478+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae781f4e20 con 0x7fae780b61e0 2024-09-10T09:23:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.478+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60007260 con 0x7fae780b61e0 2024-09-10T09:23:46.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.478+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae781e9f50 con 0x7fae780b61e0 2024-09-10T09:23:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.479+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae780b9e60 con 0x7fae780b61e0 2024-09-10T09:23:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.479+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fae60007400 con 0x7fae780b61e0 2024-09-10T09:23:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.479+0000 7fae74ff9640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fae5806bfe0 0x7fae5806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fae6008a1d0 con 0x7fae780b61e0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae74ff9640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7fae58071ea0 0x7fae580742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 --> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae60009e50 con 0x7fae58071ea0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fae60091050 con 0x7fae780b61e0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae777fe640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fae5806bfe0 0x7fae5806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae77fff640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7fae58071ea0 0x7fae580742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae77fff640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7fae58071ea0 0x7fae580742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.480+0000 7fae777fe640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fae5806bfe0 0x7fae5806e4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae68034000 tx=0x7fae6802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.481+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== osd.6 v2:172.21.15.100:6800/2090972208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae60009e50 con 0x7fae58071ea0 2024-09-10T09:23:46.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.494+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 --> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae780d1d00 con 0x7fae58071ea0 2024-09-10T09:23:46.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.494+0000 7fae74ff9640 1 -- 172.21.15.12:0/15712292 <== osd.6 v2:172.21.15.100:6800/2090972208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae780d1d00 con 0x7fae58071ea0 2024-09-10T09:23:46.495 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:46.495 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:46.495 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:46.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.494+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7fae58071ea0 msgr2=0x7fae580742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.494+0000 7fae7dd4b640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6800/2090972208,v1:172.21.15.100:6801/2090972208] conn(0x7fae58071ea0 0x7fae580742c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fae5806bfe0 msgr2=0x7fae5806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fae5806bfe0 0x7fae5806e4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae68034000 tx=0x7fae6802e000 comp rx=0 tx=0).stop 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 msgr2=0x7fae7815d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 --2- 172.21.15.12:0/15712292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae780b61e0 0x7fae7815d840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c3f0 tx=0x7fae6000c8b0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae77fff640 1 -- 172.21.15.12:0/15712292 reap_dead start 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 shutdown_connections 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 >> 172.21.15.12:0/15712292 conn(0x7fae780d11e0 msgr2=0x7fae780cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 shutdown_connections 2024-09-10T09:23:46.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.495+0000 7fae7dd4b640 1 -- 172.21.15.12:0/15712292 wait complete. 2024-09-10T09:23:46.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T09:23:46.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.608+0000 7f9b89c6e640 1 Processor -- start 2024-09-10T09:23:46.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.608+0000 7f9b89c6e640 1 -- start start 2024-09-10T09:23:46.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b89c6e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b8415e500 0x7f9b840b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b89c6e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b8415e8e0 0x7f9b840b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b89c6e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b84074200 con 0x7f9b84073cb0 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b89c6e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9b840b6e80 con 0x7f9b8415e500 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b89c6e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9b840b7160 con 0x7f9b8415e8e0 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b8415e500 0x7f9b840b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b8415e500 0x7f9b840b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39640/0 (socket says 172.21.15.12:39640) 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 -- 172.21.15.12:0/1846053508 learned_addr learned my addr 172.21.15.12:0/1846053508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b82ffd640 1 --2- 172.21.15.12:0/1846053508 >> v2:172.21.15.100:3300/0 conn(0x7f9b8415e8e0 0x7f9b840b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 -- 172.21.15.12:0/1846053508 >> v2:172.21.15.100:3300/0 conn(0x7f9b8415e8e0 msgr2=0x7f9b840b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 --2- 172.21.15.12:0/1846053508 >> v2:172.21.15.100:3300/0 conn(0x7f9b8415e8e0 0x7f9b840b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 -- 172.21.15.12:0/1846053508 >> v1:172.21.15.100:6789/0 conn(0x7f9b84073cb0 legacy=0x7f9b841622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.609+0000 7f9b837fe640 1 -- 172.21.15.12:0/1846053508 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b840b7440 con 0x7f9b8415e500 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.610+0000 7f9b837fe640 1 --2- 172.21.15.12:0/1846053508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b840b4460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009870 tx=0x7f9b7402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca55af8255c4407 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.610+0000 7f9b827fc640 1 -- 172.21.15.12:0/1846053508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74037070 con 0x7f9b8415e500 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.610+0000 7f9b827fc640 1 -- 172.21.15.12:0/1846053508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b74032440 con 0x7f9b8415e500 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.610+0000 7f9b827fc640 1 -- 172.21.15.12:0/1846053508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74032810 con 0x7f9b8415e500 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 -- 172.21.15.12:0/1846053508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 msgr2=0x7f9b840b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/1846053508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b840b4460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009870 tx=0x7f9b7402a210 comp rx=0 tx=0).stop 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 -- 172.21.15.12:0/1846053508 shutdown_connections 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/1846053508 >> v2:172.21.15.100:3300/0 conn(0x7f9b8415e8e0 0x7f9b840b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/1846053508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b840b4460 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 -- 172.21.15.12:0/1846053508 >> 172.21.15.12:0/1846053508 conn(0x7f9b84062810 msgr2=0x7f9b84062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 -- 172.21.15.12:0/1846053508 shutdown_connections 2024-09-10T09:23:46.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.611+0000 7f9b89c6e640 1 -- 172.21.15.12:0/1846053508 wait complete. 2024-09-10T09:23:46.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.612+0000 7f9b89c6e640 1 Processor -- start 2024-09-10T09:23:46.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.612+0000 7f9b89c6e640 1 -- start start 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b89c6e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b84073cb0 0x7f9b841e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b89c6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b841520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b89c6e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b8415e8e0 0x7f9b840cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b89c6e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8406ce30 con 0x7f9b8415e500 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b89c6e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8406ccb0 con 0x7f9b84073cb0 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b89c6e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9b840d1cf0 con 0x7f9b8415e8e0 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b841520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b841520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39654/0 (socket says 172.21.15.12:39654) 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 -- 172.21.15.12:0/2508216711 learned_addr learned my addr 172.21.15.12:0/2508216711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b837fe640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b84073cb0 0x7f9b841e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b83fff640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b8415e8e0 0x7f9b840cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 -- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b8415e8e0 msgr2=0x7f9b840cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b8415e8e0 0x7f9b840cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 -- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b84073cb0 msgr2=0x7f9b841e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b84073cb0 0x7f9b841e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b82ffd640 1 -- 172.21.15.12:0/2508216711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b841e80c0 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.613+0000 7f9b83fff640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b8415e8e0 0x7f9b840cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.614+0000 7f9b82ffd640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b841520d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800e8a0 tx=0x7f9b7800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.614+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b78017070 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.614+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7800ee90 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.614+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800cb40 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.614+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841e83a0 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.614+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841e8960 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.615+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b840b4460 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.615+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f9b7801a070 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.616+0000 7f9b6bfff640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9b7006bfe0 0x7f9b7006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.616+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9b7808b010 con 0x7f9b8415e500 2024-09-10T09:23:46.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.616+0000 7f9b837fe640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9b7006bfe0 0x7f9b7006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.617+0000 7f9b837fe640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9b7006bfe0 0x7f9b7006e4a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b74034000 tx=0x7f9b7402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.620+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b780593f0 con 0x7f9b8415e500 2024-09-10T09:23:46.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.794+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f9b84069160 con 0x7f9b7006bfe0 2024-09-10T09:23:46.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.795+0000 7f9b6bfff640 1 -- 172.21.15.12:0/2508216711 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9b84069160 con 0x7f9b7006bfe0 2024-09-10T09:23:46.796 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9b7006bfe0 msgr2=0x7f9b7006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9b7006bfe0 0x7f9b7006e4a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b74034000 tx=0x7f9b7402e000 comp rx=0 tx=0).stop 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 msgr2=0x7f9b841520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b841520d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800e8a0 tx=0x7f9b7800ed60 comp rx=0 tx=0).stop 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 shutdown_connections 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f9b7006bfe0 0x7f9b7006e4a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b8415e8e0 0x7f9b840cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b8415e500 0x7f9b841520d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 --2- 172.21.15.12:0/2508216711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b84073cb0 0x7f9b841e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 >> 172.21.15.12:0/2508216711 conn(0x7f9b84062810 msgr2=0x7f9b840b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 shutdown_connections 2024-09-10T09:23:46.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.797+0000 7f9b89c6e640 1 -- 172.21.15.12:0/2508216711 wait complete. 2024-09-10T09:23:46.809 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T09:23:46.809 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T09:23:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.914+0000 7faa286f1640 1 Processor -- start 2024-09-10T09:23:46.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.914+0000 7faa286f1640 1 -- start start 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa286f1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa200b3bc0 0x7faa200d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa286f1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa200d2420 con 0x7faa2015e940 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa286f1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa200d33d0 con 0x7faa200cf640 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa286f1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faa200d4110 con 0x7faa200b3bc0 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa25c8c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa200b3bc0 0x7faa200d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa2648d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faa2015e940 0x7faa200cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58490/0 (socket says 172.21.15.12:58490) 2024-09-10T09:23:46.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.915+0000 7faa2648d640 1 -- 172.21.15.12:0/93321992 learned_addr learned my addr 172.21.15.12:0/93321992 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:23:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.916+0000 7faa25c8c640 1 -- 172.21.15.12:0/93321992 >> v1:172.21.15.100:6789/0 conn(0x7faa200cf640 legacy=0x7faa200cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.916+0000 7faa25c8c640 1 -- 172.21.15.12:0/93321992 >> v1:172.21.15.12:6789/0 conn(0x7faa2015e940 legacy=0x7faa200cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.916+0000 7faa25c8c640 1 -- 172.21.15.12:0/93321992 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200d36b0 con 0x7faa200b3bc0 2024-09-10T09:23:46.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.916+0000 7faa2548b640 1 -- 172.21.15.12:0/93321992 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359881056 0 0) 0x7faa200d2420 con 0x7faa2015e940 2024-09-10T09:23:46.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.916+0000 7faa25c8c640 1 --2- 172.21.15.12:0/93321992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa200b3bc0 0x7faa200d3bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faa100097a0 tx=0x7faa1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1dc1670496cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa2548b640 1 -- 172.21.15.12:0/93321992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10037070 con 0x7faa200b3bc0 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa2548b640 1 -- 172.21.15.12:0/93321992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa10032440 con 0x7faa200b3bc0 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa2548b640 1 -- 172.21.15.12:0/93321992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10032810 con 0x7faa200b3bc0 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 -- 172.21.15.12:0/93321992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa200b3bc0 msgr2=0x7faa200d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 --2- 172.21.15.12:0/93321992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa200b3bc0 0x7faa200d3bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faa100097a0 tx=0x7faa1002a270 comp rx=0 tx=0).stop 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 -- 172.21.15.12:0/93321992 shutdown_connections 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 --2- 172.21.15.12:0/93321992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa200b3bc0 0x7faa200d3bd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 -- 172.21.15.12:0/93321992 >> 172.21.15.12:0/93321992 conn(0x7faa200d1780 msgr2=0x7faa200d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 -- 172.21.15.12:0/93321992 shutdown_connections 2024-09-10T09:23:46.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.917+0000 7faa286f1640 1 -- 172.21.15.12:0/93321992 wait complete. 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.918+0000 7faa286f1640 1 Processor -- start 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.918+0000 7faa286f1640 1 -- start start 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa286f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa200b3bc0 0x7faa200b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa286f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa200cf640 0x7faa20157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa286f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa2015e940 0x7faa201577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa286f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa200cfc10 con 0x7faa2015e940 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa286f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa2015ed20 con 0x7faa200cf640 2024-09-10T09:23:46.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa286f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7faa200d52b0 con 0x7faa200b3bc0 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa26c8e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa2015e940 0x7faa201577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa26c8e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa2015e940 0x7faa201577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39670/0 (socket says 172.21.15.12:39670) 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa26c8e640 1 -- 172.21.15.12:0/2265628979 learned_addr learned my addr 172.21.15.12:0/2265628979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa25c8c640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa200cf640 0x7faa20157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.919+0000 7faa2648d640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa200b3bc0 0x7faa200b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa26c8e640 1 -- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa200b3bc0 msgr2=0x7faa200b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa26c8e640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faa200b3bc0 0x7faa200b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa26c8e640 1 -- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa200cf640 msgr2=0x7faa20157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa26c8e640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa200cf640 0x7faa20157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa26c8e640 1 -- 172.21.15.12:0/2265628979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200b7e00 con 0x7faa2015e940 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa26c8e640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa2015e940 0x7faa201577c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c6d0 tx=0x7faa1800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18016020 con 0x7faa2015e940 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1800a840 con 0x7faa2015e940 2024-09-10T09:23:46.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa200b80e0 con 0x7faa2015e940 2024-09-10T09:23:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1800ac70 con 0x7faa2015e940 2024-09-10T09:23:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.920+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa200b86a0 con 0x7faa2015e940 2024-09-10T09:23:46.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.921+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa200d3bd0 con 0x7faa2015e940 2024-09-10T09:23:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7faa18019020 con 0x7faa2015e940 2024-09-10T09:23:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa16ffd640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa0406bfe0 0x7faa0406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7faa1808b480 con 0x7faa2015e940 2024-09-10T09:23:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa16ffd640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7faa04071ea0 0x7faa040742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 --> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa18010e50 con 0x7faa04071ea0 2024-09-10T09:23:46.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa2648d640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa0406bfe0 0x7faa0406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.922+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7faa18092050 con 0x7faa2015e940 2024-09-10T09:23:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.923+0000 7faa25c8c640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7faa04071ea0 0x7faa040742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.923+0000 7faa2648d640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa0406bfe0 0x7faa0406e4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa1c000f60 tx=0x7faa1c007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.923+0000 7faa25c8c640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7faa04071ea0 0x7faa040742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:46.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.924+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== osd.7 v2:172.21.15.100:6824/4121682080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa18010e50 con 0x7faa04071ea0 2024-09-10T09:23:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.936+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 --> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa200cb0b0 con 0x7faa04071ea0 2024-09-10T09:23:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa16ffd640 1 -- 172.21.15.12:0/2265628979 <== osd.7 v2:172.21.15.100:6824/4121682080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faa200cb0b0 con 0x7faa04071ea0 2024-09-10T09:23:46.937 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-10T09:23:46.938 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T09:23:46.938 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-10T09:23:46.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7faa04071ea0 msgr2=0x7faa040742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6824/4121682080,v1:172.21.15.100:6825/4121682080] conn(0x7faa04071ea0 0x7faa040742c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa0406bfe0 msgr2=0x7faa0406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7faa0406bfe0 0x7faa0406e4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa1c000f60 tx=0x7faa1c007c00 comp rx=0 tx=0).stop 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa2015e940 msgr2=0x7faa201577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 --2- 172.21.15.12:0/2265628979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa2015e940 0x7faa201577c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c6d0 tx=0x7faa1800cb90 comp rx=0 tx=0).stop 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa26c8e640 1 -- 172.21.15.12:0/2265628979 reap_dead start 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 shutdown_connections 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 >> 172.21.15.12:0/2265628979 conn(0x7faa200d1780 msgr2=0x7faa201588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 shutdown_connections 2024-09-10T09:23:46.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:46.937+0000 7faa286f1640 1 -- 172.21.15.12:0/2265628979 wait complete. 2024-09-10T09:23:46.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T09:23:47.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.051+0000 7f233fdfd640 1 Processor -- start 2024-09-10T09:23:47.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.051+0000 7f233fdfd640 1 -- start start 2024-09-10T09:23:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233fdfd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23380d02a0 0x7f23380d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233fdfd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f233815ca40 0x7f233815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233fdfd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f233815ce80 0x7f23381594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233fdfd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f23380d0bc0 con 0x7f233815ce80 2024-09-10T09:23:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233fdfd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f233815d390 con 0x7f233815ca40 2024-09-10T09:23:47.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233fdfd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f233815d670 con 0x7f23380d02a0 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f233815ce80 0x7f23381594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f233815ce80 0x7f23381594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39682/0 (socket says 172.21.15.12:39682) 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 -- 172.21.15.12:0/239678002 learned_addr learned my addr 172.21.15.12:0/239678002 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233d398640 1 --2- 172.21.15.12:0/239678002 >> v2:172.21.15.100:3300/0 conn(0x7f233815ca40 0x7f233815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233db99640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23380d02a0 0x7f23380d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 -- 172.21.15.12:0/239678002 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23380d02a0 msgr2=0x7f23380d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23380d02a0 0x7f23380d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 -- 172.21.15.12:0/239678002 >> v2:172.21.15.100:3300/0 conn(0x7f233815ca40 msgr2=0x7f233815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 --2- 172.21.15.12:0/239678002 >> v2:172.21.15.100:3300/0 conn(0x7f233815ca40 0x7f233815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233e39a640 1 -- 172.21.15.12:0/239678002 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233815d950 con 0x7f233815ce80 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233db99640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23380d02a0 0x7f23380d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:47.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.052+0000 7f233d398640 1 --2- 172.21.15.12:0/239678002 >> v2:172.21.15.100:3300/0 conn(0x7f233815ca40 0x7f233815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.053+0000 7f233e39a640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ce80 0x7f23381594c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f233806f400 tx=0x7f233002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dab1cbce3429af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.053+0000 7f233cb97640 1 -- 172.21.15.12:0/239678002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330036070 con 0x7f233815ce80 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.053+0000 7f233cb97640 1 -- 172.21.15.12:0/239678002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2330031600 con 0x7f233815ce80 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233cb97640 1 -- 172.21.15.12:0/239678002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23300319d0 con 0x7f233815ce80 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 -- 172.21.15.12:0/239678002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ce80 msgr2=0x7f23381594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ce80 0x7f23381594c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f233806f400 tx=0x7f233002a610 comp rx=0 tx=0).stop 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 -- 172.21.15.12:0/239678002 shutdown_connections 2024-09-10T09:23:47.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ce80 0x7f23381594c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 --2- 172.21.15.12:0/239678002 >> v2:172.21.15.100:3300/0 conn(0x7f233815ca40 0x7f233815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 --2- 172.21.15.12:0/239678002 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23380d02a0 0x7f23380d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 -- 172.21.15.12:0/239678002 >> 172.21.15.12:0/239678002 conn(0x7f2338062cc0 msgr2=0x7f233806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 -- 172.21.15.12:0/239678002 shutdown_connections 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.054+0000 7f233fdfd640 1 -- 172.21.15.12:0/239678002 wait complete. 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.055+0000 7f233fdfd640 1 Processor -- start 2024-09-10T09:23:47.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.055+0000 7f233fdfd640 1 -- start start 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233fdfd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23380d02a0 0x7f233814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233fdfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 0x7f233814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233fdfd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f233815ce80 0x7f233815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233fdfd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2338155b90 con 0x7f233815ca40 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233fdfd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f233815df10 con 0x7f23380d02a0 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233fdfd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2338155d10 con 0x7f233815ce80 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233d398640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 0x7f233814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233d398640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 0x7f233814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39686/0 (socket says 172.21.15.12:39686) 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233d398640 1 -- 172.21.15.12:0/742594068 learned_addr learned my addr 172.21.15.12:0/742594068 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233db99640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23380d02a0 0x7f233814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.056+0000 7f233e39a640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f233815ce80 0x7f233815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233d398640 1 -- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f233815ce80 msgr2=0x7f233815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233d398640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f233815ce80 0x7f233815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233d398640 1 -- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23380d02a0 msgr2=0x7f233814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233d398640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23380d02a0 0x7f233814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233d398640 1 -- 172.21.15.12:0/742594068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2338159e70 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233d398640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 0x7f233814e3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f232800d7d0 tx=0x7f232800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280096a0 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2328019070 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328009a80 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2338159930 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.057+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233815a3c0 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.058+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23380b4790 con 0x7f233815ca40 2024-09-10T09:23:47.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.058+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2328009c20 con 0x7f233815ca40 2024-09-10T09:23:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.059+0000 7f232e7fc640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f231c06c010 0x7f231c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.059+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f232808b040 con 0x7f233815ca40 2024-09-10T09:23:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.059+0000 7f233db99640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f231c06c010 0x7f231c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.060+0000 7f233db99640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f231c06c010 0x7f231c06e4d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2338074220 tx=0x7f2334008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:47.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.063+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23280594b0 con 0x7f233815ca40 2024-09-10T09:23:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.239+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f23380af950 con 0x7f231c06c010 2024-09-10T09:23:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.239+0000 7f232e7fc640 1 -- 172.21.15.12:0/742594068 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23380af950 con 0x7f231c06c010 2024-09-10T09:23:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T09:23:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f231c06c010 msgr2=0x7f231c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f231c06c010 0x7f231c06e4d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2338074220 tx=0x7f2334008040 comp rx=0 tx=0).stop 2024-09-10T09:23:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 msgr2=0x7f233814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 0x7f233814e3b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f232800d7d0 tx=0x7f232800dc90 comp rx=0 tx=0).stop 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 shutdown_connections 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f231c06c010 0x7f231c06e4d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f233815ce80 0x7f233815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f233815ca40 0x7f233814e3b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 --2- 172.21.15.12:0/742594068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23380d02a0 0x7f233814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 >> 172.21.15.12:0/742594068 conn(0x7f2338062cc0 msgr2=0x7f23380b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 shutdown_connections 2024-09-10T09:23:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.241+0000 7f233fdfd640 1 -- 172.21.15.12:0/742594068 wait complete. 2024-09-10T09:23:47.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:23:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.355+0000 7fa299827640 1 Processor -- start 2024-09-10T09:23:47.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.355+0000 7fa299827640 1 -- start start 2024-09-10T09:23:47.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa299827640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa29415ed20 0x7fa2940b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa299827640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2940b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa299827640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2940b7170 con 0x7fa29415e940 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa299827640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa2940b7aa0 con 0x7fa29415ed20 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa299827640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa2940d3660 con 0x7fa2940cef90 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa2927fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa29415ed20 0x7fa2940b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa2927fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa29415ed20 0x7fa2940b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39700/0 (socket says 172.21.15.12:39700) 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.356+0000 7fa2927fc640 1 -- 172.21.15.12:0/1984144472 learned_addr learned my addr 172.21.15.12:0/1984144472 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.357+0000 7fa2937fe640 1 --2- 172.21.15.12:0/1984144472 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2940b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.357+0000 7fa2927fc640 1 -- 172.21.15.12:0/1984144472 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 msgr2=0x7fa2940b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.357+0000 7fa2927fc640 1 --2- 172.21.15.12:0/1984144472 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2940b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.357+0000 7fa2927fc640 1 -- 172.21.15.12:0/1984144472 >> v1:172.21.15.100:6789/0 conn(0x7fa29415e940 legacy=0x7fa2940d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.357+0000 7fa2927fc640 1 -- 172.21.15.12:0/1984144472 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2940d3940 con 0x7fa29415ed20 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.357+0000 7fa2927fc640 1 --2- 172.21.15.12:0/1984144472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa2940b3220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009870 tx=0x7fa27c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3ea0cd826703d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa291ffb640 1 -- 172.21.15.12:0/1984144472 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c037070 con 0x7fa29415ed20 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa291ffb640 1 -- 172.21.15.12:0/1984144472 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c02ae50 con 0x7fa29415ed20 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa291ffb640 1 -- 172.21.15.12:0/1984144472 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c032860 con 0x7fa29415ed20 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 -- 172.21.15.12:0/1984144472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 msgr2=0x7fa2940b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 --2- 172.21.15.12:0/1984144472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa2940b3220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009870 tx=0x7fa27c02a300 comp rx=0 tx=0).stop 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 -- 172.21.15.12:0/1984144472 shutdown_connections 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 --2- 172.21.15.12:0/1984144472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa2940b3220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 --2- 172.21.15.12:0/1984144472 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2940b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 -- 172.21.15.12:0/1984144472 >> 172.21.15.12:0/1984144472 conn(0x7fa2940b6240 msgr2=0x7fa2940b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 -- 172.21.15.12:0/1984144472 shutdown_connections 2024-09-10T09:23:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.358+0000 7fa299827640 1 -- 172.21.15.12:0/1984144472 wait complete. 2024-09-10T09:23:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.359+0000 7fa299827640 1 Processor -- start 2024-09-10T09:23:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 -- start start 2024-09-10T09:23:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2941e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29415e940 0x7fa29415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa29415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2940d3310 con 0x7fa29415ed20 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2940d3f00 con 0x7fa29415e940 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.360+0000 7fa299827640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa2940d1ef0 con 0x7fa2940cef90 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa29415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa29415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39708/0 (socket says 172.21.15.12:39708) 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 -- 172.21.15.12:0/4098542701 learned_addr learned my addr 172.21.15.12:0/4098542701 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa292ffd640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2941e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2927fc640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29415e940 0x7fa29415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 -- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 msgr2=0x7fa2941e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2941e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 -- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29415e940 msgr2=0x7fa29415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29415e940 0x7fa29415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 -- 172.21.15.12:0/4098542701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2941e84d0 con 0x7fa29415ed20 2024-09-10T09:23:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa2937fe640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa29415a540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa28c007e40 tx=0x7fa28c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c014620 con 0x7fa29415ed20 2024-09-10T09:23:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c019070 con 0x7fa29415ed20 2024-09-10T09:23:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2941e7c30 con 0x7fa29415ed20 2024-09-10T09:23:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c014a20 con 0x7fa29415ed20 2024-09-10T09:23:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.361+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2941e81f0 con 0x7fa29415ed20 2024-09-10T09:23:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.362+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa294068e90 con 0x7fa29415ed20 2024-09-10T09:23:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.363+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fa28c014bc0 con 0x7fa29415ed20 2024-09-10T09:23:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.363+0000 7fa28bfff640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa27406bfe0 0x7fa27406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:23:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.363+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fa28c08b550 con 0x7fa29415ed20 2024-09-10T09:23:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.364+0000 7fa292ffd640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa27406bfe0 0x7fa27406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:23:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.364+0000 7fa292ffd640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa27406bfe0 0x7fa27406e4a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa284001780 tx=0x7fa284009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:23:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.368+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa294068e90 con 0x7fa29415ed20 2024-09-10T09:23:47.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.543+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa29415e4a0 con 0x7fa27406bfe0 2024-09-10T09:23:47.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.544+0000 7fa28bfff640 1 -- 172.21.15.12:0/4098542701 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13468 (secure 0 0 0) 0x7fa29415e4a0 con 0x7fa27406bfe0 2024-09-10T09:23:47.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:23:47.545 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa27406bfe0 msgr2=0x7fa27406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa27406bfe0 0x7fa27406e4a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa284001780 tx=0x7fa284009040 comp rx=0 tx=0).stop 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 msgr2=0x7fa29415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa29415a540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa28c007e40 tx=0x7fa28c00e4b0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 shutdown_connections 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7fa27406bfe0 0x7fa27406e4a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa29415ed20 0x7fa29415a540 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29415e940 0x7fa29415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 --2- 172.21.15.12:0/4098542701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2940cef90 0x7fa2941e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 >> 172.21.15.12:0/4098542701 conn(0x7fa2940b6240 msgr2=0x7fa29415f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 shutdown_connections 2024-09-10T09:23:47.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:23:47.547+0000 7fa299827640 1 -- 172.21.15.12:0/4098542701 wait complete. 2024-09-10T09:23:47.558 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-10T09:23:47.236888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220548,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754172,"statfs":{"total":773094113280,"available":772868272128,"internally_reserved":0,"allocated":4399104,"data_stored":2420176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-136,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-5,"num_write_kb":-3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001964"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T09:23:37.348351+0000","last_change":"2024-09-10T09:22:28.890351+0000","last_active":"2024-09-10T09:23:37.348351+0000","last_peered":"2024-09-10T09:23:37.348351+0000","last_clean":"2024-09-10T09:23:37.348351+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:37.348351+0000","last_undegraded":"2024-09-10T09:23:37.348351+0000","last_fullsized":"2024-09-10T09:23:37.348351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:22:27.727226+0000","last_clean_scrub_stamp":"2024-09-10T09:22:27.727226+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:06.754406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":995328,"data_stored":745298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":995328,"data_stored":745298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:23:47.561 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T09:22:27.727226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=9, tm_min=22, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=9, tm_min=23, tm_sec=42, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T09:23:47.561 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T09:24:04.145 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:24:04.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:24:07.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T09:24:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.677+0000 7f66f9df6640 1 Processor -- start 2024-09-10T09:24:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.677+0000 7f66f9df6640 1 -- start start 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.677+0000 7f66f9df6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f66f415ed20 0x7f66f40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.677+0000 7f66f9df6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f40b7170 con 0x7f66f415e940 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.677+0000 7f66f9df6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f40b7aa0 con 0x7f66f40cef90 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.677+0000 7f66f9df6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f66f40d3660 con 0x7f66f415ed20 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f66f415e940 0x7f66f40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51006/0 (socket says 172.21.15.12:51006) 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f37fe640 1 -- 172.21.15.12:0/2969677314 learned_addr learned my addr 172.21.15.12:0/2969677314 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f2ffd640 1 --2- 172.21.15.12:0/2969677314 >> v2:172.21.15.100:3300/0 conn(0x7f66f415ed20 0x7f66f40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947375934 0 0) 0x7f66e4001490 con 0x7f66f415e940 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66dc003520 con 0x7f66f415e940 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096346810 0 0) 0x7f66f40b7aa0 con 0x7f66f40cef90 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e4001490 con 0x7f66f40cef90 2024-09-10T09:24:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1744910538 0 0) 0x7f66dc003520 con 0x7f66f415e940 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 >> v2:172.21.15.100:3300/0 conn(0x7f66f415ed20 msgr2=0x7f66f40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 --2- 172.21.15.12:0/2969677314 >> v2:172.21.15.100:3300/0 conn(0x7f66f415ed20 0x7f66f40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 >> v1:172.21.15.100:6789/0 conn(0x7f66f40cef90 legacy=0x7f66f40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f40d3940 con 0x7f66f415e940 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4211578671 0 0) 0x7f66e4001bc0 con 0x7f66f415e940 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 >> v1:172.21.15.12:6789/0 conn(0x7f66f415e940 legacy=0x7f66f40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66dc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66dc004800 0x7f66dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66dc0051c0 0x7f66dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f66f40d3660 con 0x7f66dc003b90 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc00bfe0 con 0x7f66dc0051c0 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc00c1e0 con 0x7f66dc004800 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.678+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66dc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f3fff640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66dc0051c0 0x7f66dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f2ffd640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66dc004800 0x7f66dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f37fe640 1 -- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66dc004800 msgr2=0x7f66dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66dc004800 0x7f66dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f37fe640 1 -- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66dc0051c0 msgr2=0x7f66dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66dc0051c0 0x7f66dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f3fff640 1 -- 172.21.15.12:0/2969677314 reap_dead start 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.679+0000 7f66f37fe640 1 -- 172.21.15.12:0/2969677314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc003520 con 0x7f66dc003b90 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66dc003f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f66e400a920 tx=0x7f66dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54ceebc2669ed17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e400a540 con 0x7f66dc003b90 2024-09-10T09:24:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e402f070 con 0x7f66dc003b90 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f27fc640 1 -- 172.21.15.12:0/2969677314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e402bdb0 con 0x7f66dc003b90 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 -- 172.21.15.12:0/2969677314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 msgr2=0x7f66dc003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66dc003f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f66e400a920 tx=0x7f66dc005830 comp rx=0 tx=0).stop 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 -- 172.21.15.12:0/2969677314 shutdown_connections 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2969677314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66dc003f90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 -- 172.21.15.12:0/2969677314 >> 172.21.15.12:0/2969677314 conn(0x7f66f40b6240 msgr2=0x7f66f40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 -- 172.21.15.12:0/2969677314 shutdown_connections 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.680+0000 7f66f9df6640 1 -- 172.21.15.12:0/2969677314 wait complete. 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.682+0000 7f66f9df6640 1 Processor -- start 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.682+0000 7f66f9df6640 1 -- start start 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66f40c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66f4158800 0x7f66f41616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f40b5590 0x7f66f40b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f66f40d1ef0 con 0x7f66dc003b90 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66f40d3f00 con 0x7f66f40b5590 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f66f40d2070 con 0x7f66f4158800 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66f40c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66f40c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37436/0 (socket says 172.21.15.12:37436) 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 -- 172.21.15.12:0/2992378658 learned_addr learned my addr 172.21.15.12:0/2992378658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f2ffd640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66f4158800 0x7f66f41616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f3fff640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f40b5590 0x7f66f40b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 -- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66f4158800 msgr2=0x7f66f41616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66f4158800 0x7f66f41616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 -- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f40b5590 msgr2=0x7f66f40b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f40b5590 0x7f66f40b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 -- 172.21.15.12:0/2992378658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f4158cc0 con 0x7f66dc003b90 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f37fe640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66f40c8380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f66e400aa40 tx=0x7f66e402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e400a540 con 0x7f66dc003b90 2024-09-10T09:24:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4034670 con 0x7f66dc003b90 2024-09-10T09:24:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f4158fa0 con 0x7f66dc003b90 2024-09-10T09:24:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.683+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4034a20 con 0x7f66dc003b90 2024-09-10T09:24:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.684+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f4159560 con 0x7f66dc003b90 2024-09-10T09:24:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.684+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f40d1060 con 0x7f66dc003b90 2024-09-10T09:24:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.685+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f66e4034bc0 con 0x7f66dc003b90 2024-09-10T09:24:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.686+0000 7f66dbfff640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f66e006bfe0 0x7f66e006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.686+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f66e40ab1e0 con 0x7f66dc003b90 2024-09-10T09:24:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.686+0000 7f66f2ffd640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f66e006bfe0 0x7f66e006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.686+0000 7f66f2ffd640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f66e006bfe0 0x7f66e006e4a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66f415f150 tx=0x7f66e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:07.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.690+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66f40b7170 con 0x7f66dc003b90 2024-09-10T09:24:07.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.863+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 --> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66f415a0e0 con 0x7f66e006bfe0 2024-09-10T09:24:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.864+0000 7f66dbfff640 1 -- 172.21.15.12:0/2992378658 <== mgr.4102 v2:172.21.15.100:6832/3276402792 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13354 (secure 0 0 0) 0x7f66f415a0e0 con 0x7f66e006bfe0 2024-09-10T09:24:07.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:24:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f66e006bfe0 msgr2=0x7f66e006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f66e006bfe0 0x7f66e006e4a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66f415f150 tx=0x7f66e8008040 comp rx=0 tx=0).stop 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 msgr2=0x7f66f40c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66f40c8380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f66e400aa40 tx=0x7f66e402d070 comp rx=0 tx=0).stop 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 shutdown_connections 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f66e006bfe0 0x7f66e006e4a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f40b5590 0x7f66f40b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66f4158800 0x7f66f41616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 --2- 172.21.15.12:0/2992378658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66dc003b90 0x7f66f40c8380 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 >> 172.21.15.12:0/2992378658 conn(0x7f66f40b6240 msgr2=0x7f66f40b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:24:07.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 shutdown_connections 2024-09-10T09:24:07.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.866+0000 7f66f9df6640 1 -- 172.21.15.12:0/2992378658 wait complete. 2024-09-10T09:24:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-10T09:24:07.240575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220528,"kb_used_data":4296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754192,"statfs":{"total":773094113280,"available":772868292608,"internally_reserved":0,"allocated":4399104,"data_stored":2420176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12747,"internal_metadata":221236789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002060"},"pg_stats":[{"pgid":"1.0","version":"35'119","reported_seq":206,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T09:23:47.608069+0000","last_change":"2024-09-10T09:23:47.608120+0000","last_active":"2024-09-10T09:23:47.608069+0000","last_peered":"2024-09-10T09:23:47.608069+0000","last_clean":"2024-09-10T09:23:47.608069+0000","last_became_active":"2024-09-10T09:22:28.889371+0000","last_became_peered":"2024-09-10T09:22:28.889371+0000","last_unstale":"2024-09-10T09:23:47.608069+0000","last_undegraded":"2024-09-10T09:23:47.608069+0000","last_fullsized":"2024-09-10T09:23:47.608069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-10T09:23:47.607981+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-10T09:23:47.607981+0000","last_clean_scrub_stamp":"2024-09-10T09:23:47.607981+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:02.017754+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":745298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":154930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":745298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:24:07.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T09:24:07.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.979+0000 7f8e3eb1f640 1 Processor -- start 2024-09-10T09:24:07.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.980+0000 7f8e3eb1f640 1 -- start start 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.980+0000 7f8e3eb1f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e380b3d50 0x7f8e3806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.980+0000 7f8e3eb1f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e3806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.980+0000 7f8e3eb1f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e380cf9a0 con 0x7f8e38161e30 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.980+0000 7f8e3eb1f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8e380cfcf0 con 0x7f8e380b3d50 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.980+0000 7f8e3eb1f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8e38162210 con 0x7f8e380b3290 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e3806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e37fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e380b3d50 0x7f8e3806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e3806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:52002/0 (socket says 172.21.15.12:52002) 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 -- 172.21.15.12:0/3557937668 learned_addr learned my addr 172.21.15.12:0/3557937668 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 -- 172.21.15.12:0/3557937668 >> v2:172.21.15.100:3300/0 conn(0x7f8e380b3d50 msgr2=0x7f8e3806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 --2- 172.21.15.12:0/3557937668 >> v2:172.21.15.100:3300/0 conn(0x7f8e380b3d50 0x7f8e3806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 -- 172.21.15.12:0/3557937668 >> v1:172.21.15.100:6789/0 conn(0x7f8e38161e30 legacy=0x7f8e380d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e3d0bc640 1 -- 172.21.15.12:0/3557937668 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e380d5210 con 0x7f8e380b3290 2024-09-10T09:24:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.981+0000 7f8e37fff640 1 --2- 172.21.15.12:0/3557937668 >> v2:172.21.15.100:3300/0 conn(0x7f8e380b3d50 0x7f8e3806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.982+0000 7f8e3d0bc640 1 --2- 172.21.15.12:0/3557937668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e3806de00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009870 tx=0x7f8e3002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee0f070700f46359 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.982+0000 7f8e377fe640 1 -- 172.21.15.12:0/3557937668 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30037070 con 0x7f8e380b3290 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.982+0000 7f8e377fe640 1 -- 172.21.15.12:0/3557937668 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e30032440 con 0x7f8e380b3290 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.982+0000 7f8e377fe640 1 -- 172.21.15.12:0/3557937668 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30032810 con 0x7f8e380b3290 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/3557937668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 msgr2=0x7f8e3806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/3557937668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e3806de00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009870 tx=0x7f8e3002a250 comp rx=0 tx=0).stop 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/3557937668 shutdown_connections 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/3557937668 >> v2:172.21.15.100:3300/0 conn(0x7f8e380b3d50 0x7f8e3806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/3557937668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e3806de00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/3557937668 >> 172.21.15.12:0/3557937668 conn(0x7f8e380d1870 msgr2=0x7f8e380d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:24:07.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/3557937668 shutdown_connections 2024-09-10T09:24:07.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.983+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/3557937668 wait complete. 2024-09-10T09:24:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.984+0000 7f8e3eb1f640 1 Processor -- start 2024-09-10T09:24:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.984+0000 7f8e3eb1f640 1 -- start start 2024-09-10T09:24:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3eb1f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e38154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3eb1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 0x7f8e38154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3eb1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e38161e30 0x7f8e380c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3eb1f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e380b78b0 con 0x7f8e380b3d50 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3eb1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e380b3950 con 0x7f8e38161e30 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3eb1f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8e380b7a30 con 0x7f8e380b3290 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 0x7f8e38154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 0x7f8e38154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37448/0 (socket says 172.21.15.12:37448) 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 -- 172.21.15.12:0/908239437 learned_addr learned my addr 172.21.15.12:0/908239437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3c8bb640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e38154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3d0bc640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e38161e30 0x7f8e380c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 -- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 msgr2=0x7f8e38154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e38154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 -- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e38161e30 msgr2=0x7f8e380c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e38161e30 0x7f8e380c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 -- 172.21.15.12:0/908239437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e381f5770 con 0x7f8e380b3d50 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e3d0bc640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e38161e30 0x7f8e380c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.985+0000 7f8e37fff640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 0x7f8e38154e50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009f00 tx=0x7f8e2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.986+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20018020 con 0x7f8e380b3d50 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.986+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e20014680 con 0x7f8e380b3d50 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.986+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e381f5a50 con 0x7f8e380b3d50 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.986+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20014a70 con 0x7f8e380b3d50 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.986+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e380c8830 con 0x7f8e380b3d50 2024-09-10T09:24:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.987+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e380d34a0 con 0x7f8e380b3d50 2024-09-10T09:24:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.987+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f8e2001b020 con 0x7f8e380b3d50 2024-09-10T09:24:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.987+0000 7f8e357fa640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e1806bfe0 0x7f8e1806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.988+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f8e2008baf0 con 0x7f8e380b3d50 2024-09-10T09:24:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.988+0000 7f8e3c8bb640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e1806bfe0 0x7f8e1806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.988+0000 7f8e3c8bb640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e1806bfe0 0x7f8e1806e4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e3815e010 tx=0x7f8e28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:07.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:07.992+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e20022030 con 0x7f8e380b3d50 2024-09-10T09:24:08.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.169+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f8e3815d8b0 con 0x7f8e380b3d50 2024-09-10T09:24:08.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.172+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f8e20010040 con 0x7f8e380b3d50 2024-09-10T09:24:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.174+0000 7f8e357fa640 1 -- 172.21.15.12:0/908239437 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8e20091080 con 0x7f8e380b3d50 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e1806bfe0 msgr2=0x7f8e1806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e1806bfe0 0x7f8e1806e4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e3815e010 tx=0x7f8e28009040 comp rx=0 tx=0).stop 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 msgr2=0x7f8e38154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 0x7f8e38154e50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009f00 tx=0x7f8e2000c490 comp rx=0 tx=0).stop 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 shutdown_connections 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f8e1806bfe0 0x7f8e1806e4a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e38161e30 0x7f8e380c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e380b3d50 0x7f8e38154e50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 --2- 172.21.15.12:0/908239437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e380b3290 0x7f8e38154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 >> 172.21.15.12:0/908239437 conn(0x7f8e380d1870 msgr2=0x7f8e38161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:24:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 shutdown_connections 2024-09-10T09:24:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.175+0000 7f8e3eb1f640 1 -- 172.21.15.12:0/908239437 wait complete. 2024-09-10T09:24:08.188 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T09:24:08.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T09:24:08.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.289+0000 7f954c4c9640 1 Processor -- start 2024-09-10T09:24:08.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.289+0000 7f954c4c9640 1 -- start start 2024-09-10T09:24:08.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954c4c9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95440cf070 0x7f95440cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:08.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954c4c9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9544073120 0x7f9544073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:08.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954c4c9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95440ce740 con 0x7f954415c180 2024-09-10T09:24:08.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954c4c9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9544072640 con 0x7f95440cf070 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954c4c9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9544072920 con 0x7f9544073120 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f9549a64640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95440cf070 0x7f95440cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954a265640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f954415c180 0x7f95440cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51014/0 (socket says 172.21.15.12:51014) 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954a265640 1 -- 172.21.15.12:0/3040640030 learned_addr learned my addr 172.21.15.12:0/3040640030 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954aa66640 1 --2- 172.21.15.12:0/3040640030 >> v2:172.21.15.100:3300/0 conn(0x7f9544073120 0x7f9544073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f9549a64640 1 -- 172.21.15.12:0/3040640030 >> v2:172.21.15.100:3300/0 conn(0x7f9544073120 msgr2=0x7f9544073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f9549a64640 1 --2- 172.21.15.12:0/3040640030 >> v2:172.21.15.100:3300/0 conn(0x7f9544073120 0x7f9544073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f9549a64640 1 -- 172.21.15.12:0/3040640030 >> v1:172.21.15.12:6789/0 conn(0x7f954415c180 legacy=0x7f95440cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f9549a64640 1 -- 172.21.15.12:0/3040640030 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9544072c00 con 0x7f95440cf070 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f9549263640 1 -- 172.21.15.12:0/3040640030 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911355409 0 0) 0x7f95440ce740 con 0x7f954415c180 2024-09-10T09:24:08.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.290+0000 7f954aa66640 1 --2- 172.21.15.12:0/3040640030 >> v2:172.21.15.100:3300/0 conn(0x7f9544073120 0x7f9544073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.291+0000 7f9549a64640 1 --2- 172.21.15.12:0/3040640030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95440cf070 0x7f95440cf4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f95440cd070 tx=0x7f953402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71da461f9afc20a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.291+0000 7f9549263640 1 -- 172.21.15.12:0/3040640030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534037070 con 0x7f95440cf070 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.291+0000 7f9549263640 1 -- 172.21.15.12:0/3040640030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9534032440 con 0x7f95440cf070 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.291+0000 7f9549263640 1 -- 172.21.15.12:0/3040640030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953402ae60 con 0x7f95440cf070 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 -- 172.21.15.12:0/3040640030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95440cf070 msgr2=0x7f95440cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 --2- 172.21.15.12:0/3040640030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95440cf070 0x7f95440cf4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f95440cd070 tx=0x7f953402a110 comp rx=0 tx=0).stop 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 -- 172.21.15.12:0/3040640030 shutdown_connections 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 --2- 172.21.15.12:0/3040640030 >> v2:172.21.15.100:3300/0 conn(0x7f9544073120 0x7f9544073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 --2- 172.21.15.12:0/3040640030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95440cf070 0x7f95440cf4e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 -- 172.21.15.12:0/3040640030 >> 172.21.15.12:0/3040640030 conn(0x7f9544062cc0 msgr2=0x7f954406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 -- 172.21.15.12:0/3040640030 shutdown_connections 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.292+0000 7f954c4c9640 1 -- 172.21.15.12:0/3040640030 wait complete. 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.293+0000 7f954c4c9640 1 Processor -- start 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.293+0000 7f954c4c9640 1 -- start start 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 0x7f954414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95440cf070 0x7f95440b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f954415c180 0x7f95440cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f95440722f0 con 0x7f9544073120 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f95440ced00 con 0x7f954415c180 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f954415c560 con 0x7f95440cf070 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 0x7f954414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 0x7f954414bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37462/0 (socket says 172.21.15.12:37462) 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 -- 172.21.15.12:0/457812730 learned_addr learned my addr 172.21.15.12:0/457812730 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954aa66640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f954415c180 0x7f95440cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f9549a64640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95440cf070 0x7f95440b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 -- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95440cf070 msgr2=0x7f95440b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95440cf070 0x7f95440b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 -- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f954415c180 msgr2=0x7f95440cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f954415c180 0x7f95440cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 -- 172.21.15.12:0/457812730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95440b3690 con 0x7f9544073120 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954a265640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 0x7f954414bd60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f954000c500 tx=0x7f954000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540018070 con 0x7f9544073120 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9540007580 con 0x7f9544073120 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.294+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95440b3970 con 0x7f9544073120 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.295+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540004a40 con 0x7f9544073120 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.295+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95440b3f30 con 0x7f9544073120 2024-09-10T09:24:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.295+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95440cf4e0 con 0x7f9544073120 2024-09-10T09:24:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.296+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f954001b070 con 0x7f9544073120 2024-09-10T09:24:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.296+0000 7f953affd640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f952806bfe0 0x7f952806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:24:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.296+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f954008a1e0 con 0x7f9544073120 2024-09-10T09:24:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.297+0000 7f9549a64640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f952806bfe0 0x7f952806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:24:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.297+0000 7f9549a64640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f952806bfe0 0x7f952806e4a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9534034000 tx=0x7f953402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:24:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.301+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9540058c10 con 0x7f9544073120 2024-09-10T09:24:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.513+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9544156bc0 con 0x7f9544073120 2024-09-10T09:24:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.513+0000 7f953affd640 1 -- 172.21.15.12:0/457812730 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3914 (secure 0 0 0) 0x7f9540058510 con 0x7f9544073120 2024-09-10T09:24:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-10T09:24:08.515 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"btime":"2024-09-10T09:23:35:331641+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/865739151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":865739151},{"type":"v1","addr":"172.21.15.100:6837","nonce":865739151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1843254323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1843254323},{"type":"v1","addr":"172.21.15.12:6833","nonce":1843254323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4574,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3371287056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3371287056},{"type":"v1","addr":"172.21.15.12:6835","nonce":3371287056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5023,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/3668675333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3668675333},{"type":"v1","addr":"172.21.15.100:6836","nonce":3668675333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-10T09:24:08.516 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 17 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f952806bfe0 msgr2=0x7f952806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f952806bfe0 0x7f952806e4a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9534034000 tx=0x7f953402e000 comp rx=0 tx=0).stop 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 msgr2=0x7f954414bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 0x7f954414bd60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f954000c500 tx=0x7f954000c9c0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 shutdown_connections 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:6832/3276402792,v1:172.21.15.100:6833/3276402792] conn(0x7f952806bfe0 0x7f952806e4a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f954415c180 0x7f95440cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95440cf070 0x7f95440b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 --2- 172.21.15.12:0/457812730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9544073120 0x7f954414bd60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:24:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 >> 172.21.15.12:0/457812730 conn(0x7f9544062cc0 msgr2=0x7f954415aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:24:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 shutdown_connections 2024-09-10T09:24:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-10T09:24:08.515+0000 7f954c4c9640 1 -- 172.21.15.12:0/457812730 wait complete. 2024-09-10T09:24:08.529 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T09:24:08.529 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T09:24:08.529 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T09:24:08.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.539 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T09:24:08.539 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T09:24:08.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.589 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T09:24:08.589 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T09:24:08.590 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.601 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T09:24:08.601 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T09:24:08.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.653 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T09:24:08.653 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T09:24:08.653 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T09:24:08.654 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.681 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T09:24:08.681 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T09:24:08.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.745 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T09:24:08.746 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T09:24:08.746 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.810 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T09:24:08.811 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T09:24:08.811 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.876 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T09:24:08.876 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T09:24:08.877 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.913 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T09:24:08.914 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T09:24:08.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:08.980 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T09:24:08.980 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T09:24:08.980 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.051 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T09:24:09.051 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T09:24:09.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.132 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T09:24:09.132 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T09:24:09.132 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T09:24:09.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.159 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T09:24:09.160 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T09:24:09.160 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.202 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T09:24:09.202 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T09:24:09.202 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T09:24:09.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.215 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T09:24:09.215 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T09:24:09.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.254 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T09:24:09.254 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T09:24:09.255 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T09:24:09.306 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T09:24:09.306 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T09:24:09.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T09:24:09.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:24:09.346 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T09:24:09.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:24:09.549 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T09:24:09.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:24:09.633 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T09:24:09.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:24:09.723 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T09:24:09.781 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:24:09.782 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T09:24:09.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:24:09.940 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T09:24:10.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:24:10.005 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T09:24:10.054 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:24:10.054 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T09:24:10.105 INFO:tasks.ceph:Archiving mon data... 2024-09-10T09:24:10.106 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/data/mon.a.tgz 2024-09-10T09:24:10.106 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-10T09:24:10.126 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.iX6KF1LjEF 2024-09-10T09:24:10.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.iX6KF1LjEF 2024-09-10T09:24:10.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.iX6KF1LjEF 2024-09-10T09:24:10.359 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.iX6KF1LjEF is 343KB 2024-09-10T09:24:10.454 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.iX6KF1LjEF 2024-09-10T09:24:10.471 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/data/mon.b.tgz 2024-09-10T09:24:10.471 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-10T09:24:10.490 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.RPw0wssK21 2024-09-10T09:24:10.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RPw0wssK21 2024-09-10T09:24:10.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.RPw0wssK21 2024-09-10T09:24:10.739 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.RPw0wssK21 is 472KB 2024-09-10T09:24:10.837 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.RPw0wssK21 2024-09-10T09:24:10.854 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/data/mon.c.tgz 2024-09-10T09:24:10.854 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-10T09:24:10.909 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.pIr9HZiZtu 2024-09-10T09:24:10.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pIr9HZiZtu 2024-09-10T09:24:11.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.pIr9HZiZtu 2024-09-10T09:24:11.137 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.pIr9HZiZtu is 472KB 2024-09-10T09:24:11.234 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.pIr9HZiZtu 2024-09-10T09:24:11.249 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T09:24:11.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T09:24:11.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T09:24:11.341 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T09:24:11.369 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T09:24:11.369 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T09:24:11.371 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/remote/smithi012/crash 2024-09-10T09:24:11.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T09:24:11.411 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/remote/smithi100/crash 2024-09-10T09:24:11.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T09:24:11.437 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T09:24:11.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:24:11.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T09:24:11.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T09:24:11.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T09:24:11.579 INFO:tasks.ceph:Compressing logs... 2024-09-10T09:24:11.580 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T09:24:11.597 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47003.log 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44772.log 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49969.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47003.log.gz 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49855.log 2024-09-10T09:24:11.626 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.2.44772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44772.log.gz 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48011.log 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49855.log.gz 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42173.log 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48782.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48011.log.gz 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-09-10T09:24:11.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2024-09-10T09:24:11.628 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42173.log.gz 2024-09-10T09:24:11.628 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46077.log 2024-09-10T09:24:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T09:24:11.661 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36628.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.36548.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36628.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0%/var/log/ceph/ceph-mds.b.log: -- replaced with /var/log/ceph/ceph-client.admin.36628.log.gz 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36799.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36508.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43227.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36799.log.gz 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.36508.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.3.43227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43227.log.gz 2024-09-10T09:24:11.662 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36508.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42827.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36719.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.1.42827.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42827.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36670.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43223.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36719.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36759.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.3.43223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43223.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36670.log.gz 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T09:24:11.663 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36759.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36759.log.gz 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T09:24:11.664 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43826.log 2024-09-10T09:24:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42822.log 2024-09-10T09:24:11.667 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.1.43826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43826.log.gz 2024-09-10T09:24:11.673 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43822.log 2024-09-10T09:24:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.1.42822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42822.log.gz 2024-09-10T09:24:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.1.43822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43822.log.gz 2024-09-10T09:24:11.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45119.log: /var/log/ceph/ceph-client.admin.46495.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz 2024-09-10T09:24:11.699 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43361.log 2024-09-10T09:24:11.699 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46077.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43356.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43359.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43361.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45913.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46199.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48824.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45913.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48260.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2024-09-10T09:24:11.700 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46199.log.gz 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49519.log 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49687.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48260.log.gz 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49267.log 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49519.log.gz 2024-09-10T09:24:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49729.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49267.log.gz 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47969.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46793.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42691.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47969.log.gz 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41917.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46793.log.gz 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2024-09-10T09:24:11.702 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41917.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45559.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48698.log: /var/log/ceph/ceph-client.admin.43020.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45559.log: /var/log/ceph/ceph-client.admin.48428.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43853.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42131.log 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2024-09-10T09:24:11.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42003.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.42131.log.gz --verbose 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.43022.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46539.log: /var/log/ceph/ceph-client.admin.42003.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42003.log.gz 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47885.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43022.log: /var/log/ceph/ceph-client.admin.43261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47171.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz -5 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42299.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47885.log: /var/log/ceph/ceph-client.admin.47171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46285.log 2024-09-10T09:24:11.704 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47885.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47171.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42299.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46285.log: /var/log/ceph/ceph-client.admin.46583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47471.log 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46285.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46369.log 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 88.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz -- 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr: /var/log/ceph/ceph-client.admin.43026.log 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.47471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47471.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49309.log 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46369.log.gz 2024-09-10T09:24:11.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43026.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43026.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49309.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49309.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46157.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48344.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46157.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30056.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49099.log 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46157.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.30056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48344.log.gz 2024-09-10T09:24:11.706 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30056.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43685.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49057.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43685.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49099.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42089.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43685.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47801.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49057.log: /var/log/ceph/ceph-client.admin.42089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49561.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49057.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42089.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47801.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49393.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45203.log 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48656.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49561.log.gz 2024-09-10T09:24:11.707 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42215.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45685.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45203.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49393.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42215.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45203.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44335.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42215.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45685.log: /var/log/ceph/ceph-client.0.44335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45871.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44335.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45685.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46241.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45871.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2024-09-10T09:24:11.708 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45871.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46241.log: /var/log/ceph/ceph-client.admin.45077.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46241.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48470.log: /var/log/ceph/ceph-client.admin.42686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48202.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49645.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48202.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43262.log 2024-09-10T09:24:11.709 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48202.log.gz 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43262.log.gz 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48512.log: /var/log/ceph/ceph-client.admin.43769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46751.log 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2024-09-10T09:24:11.710 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45035.log 2024-09-10T09:24:11.712 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2024-09-10T09:24:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46751.log: /var/log/ceph/ceph-client.admin.45643.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46751.log.gz 2024-09-10T09:24:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43010.log 2024-09-10T09:24:11.712 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2024-09-10T09:24:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42682.log 2024-09-10T09:24:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45035.log: /var/log/ceph/ceph-client.admin.43010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47279.log 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45035.log.gz 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43010.log.gz 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42682.log.gz 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42688.log 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47279.log.gzgzip 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41490.log: /var/log/ceph/ceph-client.admin.42688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42688.log.gz 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2024-09-10T09:24:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44993.log: /var/log/ceph/ceph-client.admin.42383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48124.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46411.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48124.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46411.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48124.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46411.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43018.log: /var/log/ceph/ceph-client.admin.48614.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47675.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2024-09-10T09:24:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50009.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46327.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50009.log: /var/log/ceph/ceph-client.admin.47759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50009.log.gz 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36425.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46327.log.gz 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42425.log: /var/log/ceph/ceph-client.admin.36425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44909.log 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36425.log.gz 2024-09-10T09:24:11.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44909.log: /var/log/ceph/ceph-client.admin.47087.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44909.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46625.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42257.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42257.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43362.log 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42257.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-09-10T09:24:11.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49603.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49603.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43362.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45787.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47045.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49603.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41959.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45787.log: /var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45787.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose/var/log/ceph/ceph-mgr.y.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41959.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.41875.log 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-09-10T09:24:11.717 INFO:teuthology.orchestra.run.smithi012.stderr: /var/log/ceph/ceph-client.admin.49225.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41875.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41875.log.gz 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49225.log.gz 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46877.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48866.log: 83.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47927.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49477.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45997.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46877.log.gz 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49477.log: /var/log/ceph/ceph-client.admin.47927.log: 92.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42047.log 2024-09-10T09:24:11.718 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49477.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47129.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47927.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42047.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45997.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42685.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47129.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42047.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47129.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44776.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.2.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42685.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44776.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47591.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45392.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-09-10T09:24:11.719 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42689.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47591.log.gz 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48572.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49141.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48572.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.42689.log.gz 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49141.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.48572.log.gz -5 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49141.log.gz 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42341.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43023.log: /var/log/ceph/ceph-client.admin.43363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43027.log 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2024-09-10T09:24:11.720 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47549.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42341.log: /var/log/ceph/ceph-client.admin.43027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44468.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47549.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43027.log.gz 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42341.log.gz 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46667.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47549.log.gz 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43643.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44468.log.gz 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46709.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46667.log: /var/log/ceph/ceph-client.admin.43643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49435.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46667.log.gz 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2024-09-10T09:24:11.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43643.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46709.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49435.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43991.log 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43991.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.44330.log 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49771.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43991.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41679.log 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42467.log 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.44330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44330.log.gz 2024-09-10T09:24:11.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42467.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41679.log.gz 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47467.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45829.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42467.log.gz 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36532.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.0.47467.log.gz 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47717.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36532.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45829.log.gz 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36532.log.gz 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45314.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49351.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T09:24:11.723 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36161.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8%/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45314.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42680.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45601.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36161.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45601.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42680.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45601.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45727.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42509.log 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45727.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2024-09-10T09:24:11.724 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45727.log.gz 2024-09-10T09:24:11.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42509.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42509.log.gz 2024-09-10T09:24:11.725 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T09:24:11.731 INFO:teuthology.orchestra.run.smithi012.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T09:24:11.732 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T09:24:11.736 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T09:24:11.741 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T09:24:11.745 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T09:24:11.757 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T09:24:11.760 INFO:teuthology.orchestra.run.smithi100.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T09:24:11.771 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T09:24:11.800 INFO:teuthology.orchestra.run.smithi100.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T09:24:11.800 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T09:24:11.803 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T09:24:11.805 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-10T09:24:11.805 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m0.194s 2024-09-10T09:24:11.805 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m0.606s 2024-09-10T09:24:11.805 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.164s 2024-09-10T09:24:11.826 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T09:24:11.828 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T09:24:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.194s 2024-09-10T09:24:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m0.920s 2024-09-10T09:24:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.054s 2024-09-10T09:24:11.828 INFO:tasks.ceph:Archiving logs... 2024-09-10T09:24:11.829 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/remote/smithi012/log 2024-09-10T09:24:11.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T09:24:12.079 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/remote/smithi100/log 2024-09-10T09:24:12.080 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T09:24:12.222 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T09:24:12.243 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T09:24:12.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T09:24:12.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T09:24:12.321 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T09:24:12.331 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T09:24:12.331 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:24:12.335 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:24:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:24:12.349 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:24:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:24:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-10T09:24:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 177 63 +416us[ +531us] +/- 42ms 2024-09-10T09:24:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 63 +1432us[+1546us] +/- 66ms 2024-09-10T09:24:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 62 -2056us[-2056us] +/- 66ms 2024-09-10T09:24:12.351 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:24:12.353 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:24:12.353 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-10T09:24:12.353 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 177 61 +416us[ +420us] +/- 42ms 2024-09-10T09:24:12.353 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 61 +1426us[+1430us] +/- 66ms 2024-09-10T09:24:12.353 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 62 -2056us[-2051us] +/- 66ms 2024-09-10T09:24:12.353 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:24:12.354 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T09:24:12.363 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T09:24:12.364 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T09:24:12.372 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T09:24:12.461 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T09:24:12.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:24:12.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:24:12.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:24:12.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:24:12.581 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T09:24:12.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T09:24:12.598 INFO:teuthology.task.internal:Duration was 489.019393 seconds 2024-09-10T09:24:12.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T09:24:12.607 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T09:24:12.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T09:24:12.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T09:24:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:24:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:24:13.003 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T09:24:13.003 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-10T09:24:13.003 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T09:24:13.065 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T09:24:13.066 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T09:24:13.094 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T09:24:13.094 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T09:24:13.108 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T09:24:13.160 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T09:24:13.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T09:24:13.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T09:24:13.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T09:24:13.311 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T09:24:13.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T09:24:13.338 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T09:24:13.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T09:24:13.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:24:13.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:24:13.402 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-10T09:24:13.427 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-10T09:24:13.440 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:24:13.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:24:13.472 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:24:13.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:24:13.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T09:24:13.506 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T09:24:13.507 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/remote/smithi012 2024-09-10T09:24:13.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T09:24:13.546 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898965/remote/smithi100 2024-09-10T09:24:13.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T09:24:13.580 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T09:24:13.580 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T09:24:13.583 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T09:24:13.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T09:24:13.641 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T09:24:13.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T09:24:13.650 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T09:24:13.651 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T09:24:13.653 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T09:24:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 09:24 /home/ubuntu/cephtest 2024-09-10T09:24:13.685 INFO:teuthology.orchestra.run.smithi100.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 09:24 /home/ubuntu/cephtest 2024-09-10T09:24:13.686 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T09:24:13.697 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T09:24:13.722 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} duration: 489.0193929672241 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T09:24:13.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T09:24:13.817 INFO:teuthology.run:pass